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This document presents the 3 2002 issues of the newsletter 
"NewsWire," (volume 5). Issue Number One focuses on collaborative Web 
projects. This issue begins with descriptions of four individual projects: 
"iEARN"; "Operation RubyThroat"; "Follow the Polar Huskies!"; and "Log in 
Your Animal Roadkill! " Features that follow include: "Bringing the Global 
Grocery List Project Work to the Classroom"; "International School 
Partnerships through Technology"; "What it Takes to Develop or Participate in 
a Collaborative Web Project"; "Sources for Collaborative Web Projects"; and 
"Adult Literacy Students Explore Antarctica Virtually." Issue Number Two 
deals with handheld technologies, and features include: "The Impact of 

Technology on Education"; "Handheld Technology: The Basics"; "An Overview of 
Wireless Networking"; "Considerations When Buying a Handheld"; "Educational 
Advantages"; "Educational Concerns"; "Student Teachers and High School 
Seniors Beam the Internet"; "101 Great Educational Uses for Your Handheld 
Computer"; "Picture This!"; "Using Handheld Technologies in Schools"; and 
"Using eBooks on Handhelds." Also included in this issue are a sampling of 
projects; grant opportunities; sample educational software; handheld 
resources; and a glossary. Features of issue Number Three, which focuses on 
evaluating the impact of technology, include: "Tips for Writing an Evaluation 

Plan for a Technology Grant"; "Evaluation Questions — Guiding Inquiry in 
Schools"; "Lessons Learned from Action Research: Evaluation from the 
Trenches"; "Alabama Indicators for Measuring Progress'"; "State Guidelines for 
Enhancing Education Through Technology (EETT) Projects"; "TAGLIT: A Tool for 
Measuring a Project’s Results"; "Steps in Evaluating a School or District 
Technology Program"; "Thinking Beyond Surveys"; "Resources for Evaluation: An 
Annotated Bibliography"; and "Tools for Evaluating Technology Projects and 
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Collaborative iVeb 

No question about It! The Inter- 
net Is rich in resources for the 
classroom, and one of the most 
beneficial resources for students 
is the collaborative Web project. 
These online projects range from 
very structured activities, in 
which students share collected 
data, to fuU units of study corre- 
lated to state or local standards 
and designed by the participants. 

During the 2001-2002 school 
year, collaborative Web projects 
were a means of making inter- 
national connections. President 
George Bush and Secretary of 
Education Rod Paige highlighted 
“Friendship Through Educa- 
tion,” a consortium of groups 
brought together by IEARN 
(International Education and 
Research Network) to facilitate 
expanded links between stu- 
dents from the United States 
and students in countries with 
Muslim populations. The 
www.friendshipthrou9hedueation.or3 web- 
site links students through let- 
ters, e-mails, collaborations, 
and exchanges to build an un- 
derstanding between nations 
and to help each learn more 
about the other. 

According to the Friendship 

website, their 

projects include the foiiowlng: 
rra;3cr: 

ages liiaiie quiiis using 
fabric squares on which they 
have drawn smiley faces, to 
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Projects Abound 

share with other children who 
need comforting. The project 
was created in response to the 
needs of children receiving 
medical, hospital, or clinic care; 
experiencing the devastating 
effects of natural disasters; and 
In transition, crisis, or displace- 
ment from their homes. 

♦ Kids Share Hope: The kids of the 
Global Schoolhouse collabo- 
rate by sharing their messages 
of hope, support, and condo- 
lences In response to the Sep- 
tember 1 1, 2001 "Attack on 
America” tragedy. Students 
submit scanned drawings and 
digital photos that portray a 
feeling of hope and support. 
These messages and images 
are compiled and shared with 
school children directly Im- 
pacted by this disastrous act 
of terrorism. 

♦ Global Art: Students, primarily 
ages 5-12, create and ex- 
change artwork and writing 
with several other participating 
schools on the theme, ‘A Sense 
of Caring,’ respond to one 
another’s artwork/writing 
through e-mail conversations, 
and display tne Sense of Caring 
Artwork with descriptive writ- 
ing and e-mail messages from 
participating schcols/classes/ 
organizations in a Global Art 
Show a.t tb^ir schccle. 

Whether uie collaborative online 

project has an international 

(eoBlingtd on paje 2) 
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theme or a narrow curricular focus, teachers and 
students join with others to share data or ideas, 
draw conclusions, or develop a product. Through 
these projects, the world becomes smaller, the class- 
room becomes multi-dimensional, and learning be- 
comes authentic. 

If you have not had your class participate in a col- 
laborative online project, now is the time to begin. 
The articles in this issue of NewsWire address sev- 
eral projects to join, sites to check for project list- 
ings, tips on developing and participating in online 
projects, and experiences others have had in devel- 
oping or managing collaborative online projects. 
Perhaps they will be just the sparks you need to 
get started! ♦ 



lEARN: 

Offering Projects Since 1988 



Recognized as one of the first groups to offer 
students and teachers opportunities for online 

I collaborative projects, lEARN (International 

Educational and Research Network) at 
www.iearn.org has an extensive list of online projects. All lEARN projects focus 
on providing the following: 



♦ An inclusive and culturally diverse community 

♦ A safe and structured environment in which students can communicate 

♦ An opportunity to apply knowledge in service-learning projects 

♦ A community of educators and learners 
making a difference as part of the educational 
process 

The projects are organized in three major 
curricular groups: 

♦ Creative/Language Arts 

♦ Sclence/Envlronment/Math 

♦ Social Studies 

Participants have the option of participating in 
structured online projects that are ready to 
start (See www.iearn.org/projeets/index.html) or to work with other classrooms to de- 
sign and Implement projects specific to a curricular area or classroom need. 
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In addition to online projects, iEARN provides interactive forums, news, pro- 
fessional development opportunities, and an extensive database of members 
and projects. 

Membership in iEARN is school-based. Once a school joins lEARN, all 
teachers and students in that school have access to all network resources. 
(2001-2002 school-year prices were $100/teacher or $280/school.) 
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Operation RubyThroat: 
The Hummingbird Project 



A classroom teacher com- 
mented, “Hummingbirds are 
wonderful tools to excite stu- 
dents about learning.” This 
idea is the basic premise of 
“Operation RubyTTiroat: The 
Hummingbird ^oject,” an 
innovative, international, 
cross-disciplinary initiative 
through which students, 
teachers, and others collabo- 
rate to study the behavior 
and distribution of Ruby- 
Throated Hummingbirds 
{Archilochus colubris). 



The project is an outreach 
endeavor of the Hilton Pond 
Center for Piedmont Natural History, a 
501(c)(3) non-profit education and re- 
search site near York, South Carolina. 



Since its founding in 1982, the Hilton 
Pond Center has been the most produc- 
tive bird-banding station in the CaroU- 
nas and one of the most active in the 
southeastern United States. It is also a 
popular field trip location for K-12 stu- 
dents, education interns, teachers, col- 
lege classes, conservation groups, 
garden clubs, and civic organizations 
from across the Southeast and beyond. 
The extensive education and research 
work of the Center is described In words 
and photos at www.hiltonpond.org. 

Bill Hilton, Jr., founder and executive 
director of the Center, is the facility’s pri- 
mary research scientist. He is licensed 
by the federal Bird Banding Laboratory 
to capture wild birds, place bands on 
their legs, and release them unharmed. 

“Banding is one of the most important 
tools In helping us Iccan about bird mi 
gration,” Hilton said, “and about other 
things we wouldn’t know about birds, 
including longevity, site fidelity, and 
population dynamics. But bird banding 
is also a useful educational tool, and 
nothing I’ve ever done with students 




... - 

excites them more than catching a 
bird, banding it, and releasing it back 
into the wild. Learners of all ages can 
benefit from banding hummingbirds, 
and I see working with these tiny 
feathered creatures as the ultimate 
bird-banding experience.” 

It was this dual Interest in bird band- 
ing and hummingbirds that gave Hilton 
the idea for “Operation RubyThroat: 

The Hummingbird Project,” a unique 
initiative that challenges and connects 
student observers through the Inter- 
net. In Operation RubyThroat, partici- 
pants observe the Ruby-Throated 
Hummingbird in their home countries 
and share Information with peers 
across North and Central America. 
Students make observations on such 
hummingbird behaviors as early arrival 
dates during spring migration, num- 
bers of visits to hummingbird feeders, 
and species of native and cultivated 
flowers that are visited by humming- 
birds. Data are submitted electroni- 
cally via online forms to the Hilton 
Pond Center, which then assists par- 
ticipants in disseminating write-ups 
of their work through scientific and 
education publications and/or the 
Operation RubyThroat website at 

(continttd on n«xt paj«) 
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(continoed from previous page) 

www.rubythroat.org. Participants learn about 
natur^ history; reinforce skills in math, 
science, writing, geography, art, lan- 
guage, and other disciplines; and gain a 
deeper understanding of the need for 
environmental cooperation among 
people of the Americas. 

In March 2002, Operation RubyThroat 
affiliated with The GLOBE Program 
(www.globe.gov), an online project that al- 
lows students at GLOBE-certlfied 
schools to submit hummingbird data 
and correlate them with traditional 
GLOBE observations of atmosphere/ 
climate, hydrology, soils, land cover, 
and phenology. Non-GLOBE schools 
may follow the same hummingbird ob- 
servation protocols outlined for GLOBE 
and submit data directly to Operation 
RubyThroat via da*a@ruby*hroa*.org. 

Because hummingbirds tolerate hu- 
mans and are drawn to feeders and 
flower gardens, these tiny birds are 
ideal subjects for observation and re- 
search. In addition, the general mys- , 
tique of hummingbirds makes them 
stimulating topic for study and disciis- 
slon among children and adults of all 
ages. Operation RubyThroat capitalizes 
on such interest to raise awareness^in 
its participants of natural history apd of 
the interconnectedness — and mutti|al 
conservation needs — of countries in the 
Western Hemisphere. 

In Year One (2001-2002 academic 
year), participants in Operation 
RubyThroat were located in the United 
States, primarily in the Carollnas and 
New York. In Year Two, the project will 
expand to include participants in 38 
states and Washington D.C., and in 
Year Three to Canada, Mexico, Belize, 
Costa Rica, El Salvador, Guatemala, 
Honduras, Nicaragua, and Panama — 
everywhere Ruby-Throated Humming- 
birds regularly occur. 

.Although many teacher/studcnt groups 
are using Operation RubyThroat to en- 
hance science learning, Hilton is quick 
to point out that this is "not just a sci- 
ence project.” Operation RubyThroat is, 
by design, a cross-curricular project 
that encourages teachers to incorporate 



science into other disciplines and vice 
versa. For example, when a science 
class studies hummingbird migration, 
students also learn about geography. 

Or, when science students generate 
graphs showing how many times a 
hummingbird visits a feeder in a day, 
students master math and computer 
skills. And when an art teacher has 
students observe hummingbirds and 
make sketches, her students will learn 
about hummingbird morphology, as will 
drama students who write and perform 
a play based on hummingbird behavior. 
In keeping with current trends in edu- 
cation, Operation RubyThroat activities 
are correlated with Howard Gardner’s 
theory of “Multiple Intelligences.” 

One of the most compelling aspects of 
Operation RubyThroat principles is that 
they can be used with students at any 
grade level. Students in elementary 
school might learn to make simple ob- 
servations about hummingbirds, while 
advanced high school biology students 
might conduct hummingbird research 
projects that are worthy of publication. 
Teachers who fleld-tested Operation 
RubyThroat in the 2000-2001 academic 
year reported that project principles ex- 
cite students about science, yield de- 
monstrable improvement in science 
learning, and “aJlgn with state and local 

curriculum standards.” 

■ 

■ / 

The main goals of Operation RubyThroat 
are the following “Seven E’s”: 

♦ Enhance K-12 learning in science, 
particularly conservation and natural 
history 

♦ Expand student use of technology, 
especially in the natural sciences 

♦ Excite students about field research 
and potential careers in ecology and 
related areas 

♦ Emphasize integration of natural 
science learning into all science 
disciplines, as well as into arts and 
humanities 

♦ Enlighten students about environ- 
mental factors that affect humming- 
birds (and humans) 

♦ Encourage international under- 
standing by using technology to 
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build student and teacher networks 
in the Western Hemisphere 



♦ Establish an exemplary program 
that serves as a model for other 
cross-disciplinary projects that 
focus on new topics 



Operation RubyThroat also leads to lo- 
cal conservation efforts through which 
students and teachers protect or create 
schoolyard or backyard habitats used 
by hummingbirds and other organisms. 



Foundation and Phillips Petroleum Bird 
Conservation Fund ($17,500 each), 
Foundation for the CaroUnas Impact 
Fund ($6,000), and Perky-Pet Corpora- 
tion ($2,000). These funds wUl be used 
In Year One primarily to recruit 
teacher/ student groups from the Caro- 
llnas and New York, but participants 
from any state or country in 
which Ruby-throated Hum- 
mingbirds occur are welcome. 



Hilton Pond Center has received more 
than $80,000 in grants, corporate do- 
nations, and individual gifts to begin 
implementing Operation RubyThroat. 
Donors include The Christensen Fund 
($35,000), National Fish & Wildlife 



Details about how to join this 
exciting Internet-based learn- 
ing initiative are outlined on 
the Operation RubyThroat website at 
www.rubythroal.org. Teachers also may con 
tact Hilton Pond Center via e-mail at 
info@rubythroai.org for more information. ♦ 



Follow the Polar Huskies! 



For several years, "snow dogs” have been seen in many class- 
rooms around the United States. This is because of the NOMADS 
Adventure & Education Online Classroom Expeditions. 



NOMADS Adventure & Education (www.polarhusky.com) has com- 
bined adventure with classroom education since 1992, when 
founders Paul Pregont and MUle Porslld worked with world- 
renowned explorer and educator Will Steger as part of the 
highly acclaimed International Arctic Project (1991-1995) on a project that 
brought global awareness to the importance of Arctic Regions. The first “re- 
ports” from the trail consisted of less than ten words, sent from a 2-by-4-foot 
computer powered by a hand-cranked generator! NOMADS Adventure & 
Education, Inc. was legally incorporated in 1996 to make the adventures 
available to more schools. 



The spring 2002 six-week Pimaglhowln (translated “Living From the Land”) 
expedition began February 15, 2002. The expedition explored the wilderness 
and traveled ancient Native Ojlb-Cree paths of northern Ontario by dogsled 
with powerful polar huskies, as well as by canoe and on foot. The Journey was 
filled with unique scientific and cultural learning opportunities. 




The NOMADS project offers an interactive website and a “gated” Web commu- 
nity with a regular collaboration forum, moderated chats, digital labs, video 
and audio broadcasts from the trail, and an extensive resource database. 
Comprehensive classroom materials and online resources correlated to U.S. 
National Education Standards are prepared and sent to each school partici- 
pating in the expedition. Units within the Curriculum and Activity Guides are 
designed as multidisciplinary, hands-on, mind-engaging activities that relate 
to multiple intelligences and learning styles. 



Up to 3,000 classrooms may subscribe to each seasonal Polar Husky adventure 
for $99 each; the cost for an entire school is $299. If you are seeking a collabo- 
rative Web project that is structured in accordance with different learning lev- 
els for K-12, then check out www.polarhusky.com for the next seasonal project! 
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Log In Your Alabama Roadkill! 



Teachers in the Mountain Brook City 
Schools (Mountain Brook, AL) are 
looking for Alabama Roadkill! As part 
of their summer Annual Technology 
Academy. Mountain Brook City 
Schools (MBCS) 
participants de- 
velop technology- 
enriched units 
that correlate 
with the local 
curriculum 
framework. The 
participants are 
expected to cre- 
ate and maintain 
their web pages. 

One of the 
projects, 

Roadkill. is a 
good example of 
a collaborative 
Web project. 

Even though it is 
included in the 
sixth grade list- 
ing, author Pam 
Baugh indicates 
that the project 
is appropriate for 
any age. However, anyone who has 
worked with middle-school students 
will recognize that this project will be 
an instant hit for grades 6-8! 

The MBCS project is organized into 
two major sections: Questions and 
Performance Tasks/Projects. It uses 
the same goal as a national RoadKill 
Project: to involve students and 
teachers with scientific monitoring of 
an environmental parameter, accom- 
plished by using the Internet to record 
findings and compare the findings 
with those of other schools participat- 
ing in the project. 

The MBCS Roadkill site includes a 
Warmup -Roadkill in Alabama 
worksheet and a RoadKlll Data Form. 
On the Warmup worksheet, students 
complete the KWL chart — What we 
jteow/What we Want to know/What 
we Learned and make predictions 



about which animals they might 
find and under what conditions. 

On the RoadKlll Data Form at 
tfWW.mtnbrook.l(12.al.us/acadetny/6thgrade/ 
roadkill/InferacfiwRKill.hfrnI students enter 
their roadkill information and re- 
spond to questions about the condi- 
tions (weather, lunar phase, and 
temperature) and location (longitude, 
latitude, and type of road) that affect 
animals killed on Alabama roads. 
Using this form, students submit 
their data to the MBCS Roadkill web 
collection. They also can submit their 
findings to a national project, Roadkill 
2001, at www.edutel.org/roadkill/altJndex.html. 
In addition to submitting their find- 
ings to the Web, students graph their 
findings based on the data from the 
RoadKlll Data Form. 

Note: The na- 
tional Roadkill 
Project began 
with a National 
Science 
Foundation 
grant called 
Envlronet, 
awarded to 
Simmons Col- 
lege in Boston, 
but the project 
has been moved 
from the Simmons 

server (stlU listed on many sites as the 
link to the Roadkill Project) to the 
EduTel Communications, Inc. server 

at www.edutel.org/roadkill/altjndex.html. 

If you search the web, you will find 
several spin-offs or customizatlons. 
For instance, a great example of a 
“make it fit your area” version is the 
Pennsylvania site at www.eh.heth.kl2.pa.ua/ 
monagacci/details.html. Take a look at the 
MBCS Roadkill project and consider 
creating a similar project for your 
locale. Our other five SEIR4TEC 
states — Georgia, North Carolina, 
Mississippi, South Carolina, and 
Florida — are also rich in roadkill! ♦ 
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Bringing the Global Grocery List Project 
iVork to the Classroom 



By David Warlick 

Note: One of the longest-running online projects is the Global Grocery List, devel 
oped by David Warlick, who has agreed to describe his experience in posting 
and managing a collaborative Web project since 1987. We hope you erjoy his 
recoUections of a project that now draws participation nationally and reaches 
international classrooms. 



Students share local 
grocery prices to 
build a growing table 
of data to be used in 
social studies, 
science, health, 
mathematics, and 
other disciplines. 



Project-based learning is a difficult concept to 
describe because it is a nearly impossible thing 
to define. There are probably as many different 
definitions of instructional projects as there are 
instructional projects. Some are very broad in 
focus, and others are narrow. Some projects ap- 
ply to a specific instructional standard, while 
others integrate a large number of skills and 
content together. Some projects require telecom- 
munications, and others can be done the old 
fashioned way — with books. Some projects are 
complex in implementation; others simple. The 
Global Grocery List project 
is the simple type. 



Begun in 1987 as an e-mail project. Global Gro- 
cery List (GGL) is the second-oldest continuing 
online project on the Internet. The project started 
in Person County, North Carolina, where I was the 
Director of Technology and first asked the ques- 
tion, “How much do groceries cost in your town?” 
That question was sent out to locations from 
Miller, Australia, to Dublin, Ireland, and points 
between over the FrEdMail network. At that time. 
Person County Schools ran one of the 37 North 
Carolina nodes to the network, and when the e- 
mail message went out with a grocery list and the 
task, students in towns and cities around half of 
the globe went to their grocery stores, collected 
prices, averaged the prices when they returned to 
their classrooms, and sent their prices, via e-mail, 
back to me. Teachers who sent in price lists were 
added to a mailing list and received a copy of all 
prices submitted from that point on. 




(confinQfld on next page) 
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Typically, teachers would keep a 
posterboard chart attached to the wall 
in their classrooms. As new price lists 
would arrive in their e-mail boxes, they 
would have students record the new 
location and its prices on the chart. 
Some teachers also kept databases of 
prices using the original AppleWorks, 
on Apple 11 computers. The growing 
table of prices could then be used 
throughout the year to demonstrate 
concepts of social studies (transporta- 
tion), science (climate), or mathematics 
(projecting trends or converting foreign 
currency). In the first year, a health 
teacher In Montana had his students 
calculate the best place to get Vitamin 
C or Vitamin A. 

After learning a little HTML and moving 
to the North Carolina State Department 
of Public Instruction, I transferred the 
Global Grocery List project to the Web. 

It was a static webpage that Included an 
explanation of the project and the gro- 
cery list. It also included all incoming 
prices, which was a giant Improvement 
since any teacher with access to the 
Web had access to all submitted prices. 

In 1996, after I left the Department of 
Public Instruction and set up office as a 
consultant, I began to learn how to pro- 
gram webpages to run off a database. 
The first project to benefit from this new 
technique was Global Grocery List. In- 
stead of sending their prices to me by e- 
mall, after which I had to enter them by 
hand Into a webpage, teachers could 
load a Web form and enter their prices 
directly onto a webpage. The prices were 
then added to a database (originally 
FileMaker Pro and now MySQL) where 
they could be accessed and printed on 
price-report webpages at any time. 

Today, GGL will accept prices based on 
metric or empirical units, in any cur- 
rency listed on the OANDA currency 
exchange site, and automatically con- 
vert prices to a common value. You can 
access prices in any currency for any 
year between 1995 and 2002 and list 
any of the commodities in the price list. 
The prices can be listed in tables for 
printing or as a tab-delimited file that 
can be imported Into a spreadsheet. 



Recently, teachers have begun making 
their own GGL websites. Here are a few: 

♦ A lesson description by Ms. Mindy 
Hensen of Cedar Valley Middle 
School, posted on the Text Center for 
Educational Technology website: 

www.teet.unt.edu 

♦ Ms. K. Johnson, of Oakrldge Elemen- 
tary School, added a GGL page to her 
classroom website: www.teacherweb.com/ 
FL/OakridgeElementary/KimJohnjon/hl.atm 

♦ Ms. Throop, of Bascomb Elementary 
School, also added a GGL page to 
her classroom website: 

http://webteeh.kenneaaw.edu/sthroop/default.htm 

♦ Ms. Cindy Best, of Whitney Young 
Elementary School, added a GGL 
page as a lesson plan for her stu- 
dents: www.jefferson.k12.ky.us/Sehools/EI- 
ementary/y 0009/99! .html 

There are two weaknesses of this 
project as it exists currently. I fre- 
quently receive e-mail messages from 
teachers asking about price lists that 
are obviously not accurate. Actually, 
this can be used as a benefit to the 
instructional process. Students need 
to see that data from the real world is 
not always as clean as data provided 
by textbooks. If the students have to 
make Judgments on whether to use an 
entry where sugar is selling for $40 a 
pound, then this is probably a good 
lesson for them. 

Secondly, participation from countries 
outside the United States is disap- 
pointing. Although many schools in 
Europe and Australia are online and 
rapidly increasing numbers are using 
the Net In Asia and parts of Africa, it is 
still difficult to get project announce- 
ments out to these audiences. There 
must be a trick to it that I will learn in 
the future. 

Until then, there is plenty to learn 
about the United States from our 
shopping carts. Check out http:// 
!andmark$4$ehools.or9/99l/in<lex.html and Join 
an ongoing collaborative Web project 
that offers many lesson opportunities 
for your classroom! ♦ 




I just bubble with excitement f()f this prqj ec tcuidthejuture of this project I do 
not want to contain my eri€^%iSm^-a^ p^ents or grandpar- 

ents that say, “Lethne slww y ou a picture of...” Except, J say, “Let me show you 
this e-mail or this project or tell you this story. ” 

My students come to class g nd ask, “Are we going f o work on the project today? 
Did we get any mail? What do you think is going on there? Did you see ... and 
... about their area on the news? When are you going to show us how to do ... 
and ... so we can do that with our partners? Why did you say they aren't able 
to write right now?” 

These daily questions reaffirm what 1 feel. They keep the fire burning, and I do 
not want it to go out for them, for future students, or for myself. This project has 
been a wonderful way to make my curriculum more relevant to teach cultural 
diversity, to teach appropriate social skills or workplace readiness (the fact that 
they may be working with someone from a different culture or race), and that 
living in a remote area doesn't mean that you are cut off from the world and the 
world's events. 

— ^Thelma Kastl, Vocational Education Teacher, 
Ashe County High School, North Carolina 



Who would not want to have this situa- 
tion in their classroom? Thelma Kastl 
and her students have been peirticlpat- 
ing in International School Peirtner- 
ships through Technology (ISPT) with a 
class in Ramat HaShetron, Israel, since 
the fall of 1997. She emd other teachers 
in North Carolina emd 40 different 
countries have leeirned that working 
emd leeirning with others from different 
countries and cultures is motivating for 
students while meiking them more 
awcU'e of the world cU'Ound them. 

The challenges of emerging technologies 
emd a global interdependent economy 
require students to develop skills in 
technology, language, emd communica- 
tion. To function effectively, they must 
understcmd emd respect other cultures, 
be able to communicate with those who 
eire culturally different, and understcmd 
events in other countries emd their im- 
pact on the United States. ISPT is a pro- 
gram of The University of North 
Carolina’s Center for International Un- 
derstanding with the objective of prepar- 
ing students to compete in today’s global 

O 




economy by improving student compe- 
tencies in technology emd cross-cultural 
communication. Teachers emd students 
use telecommunications to interact di- 
rectly with emd leenn from teachers emd 
students in other countries. 

Begun in the spring of 1997 with two 
pilot partnerships, ISPT has sponsored 
approximately 240 classroom partner- 
ships involving about 7,000 North 
Carolina students in peutnershlps with 
schools in 40 different countries. Ap- 
proximately 25 North CcU'ollna high 
school classrooms each semester axe 
peutnered with classrooms abroad. 
Schools in rural eu'eas with little or no 
exposure to other international cul- 
tures cU'e the primary focus. 

Teachers from all curricular eu'eas col- 
laborate with international partners 
to design progreuns that support their 
mutual curricular goals. Students 
implement these programs using in- 
ternet technology. ISPT has been par- 
ticularly popular and successful with 

(eontlnatd on ooxt pago) 
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second languages, social studies, and 
business education teachers. The part- 
nerships provide these students with 
real applications with real people for 
achieving curricular objectives. Their 
experiences in the program enable stu- 
dents to practice language skills, to 
learn about other cultures, to learn 
how to communicate with other cul- 
tures, and to understand how they are 
connected with the rest of the world. 

The program has defined six cultural 
communication competencies that stu- 
dents need to develop to communicate 
successfully in our global society. 

These include factual knowledge of 
countries, the ability to recognize simi- 
larities and differences in cultures, the 

ability to rec- 
ognize the 
importance of 
culture in 
communica- 
tion, the abil- 
ity to 

recognize ste- 
reotypes and 
biases, un- 
derstanding 
of the human 
impact of 
world events, 
and the abil- 
ity to respect 
cultural dif- 
ferences with- 
out agreeing 

with them. These competencies have 
been correlated with all high school 
curricular areas in the North Carolina 
Standard Course of Study. 







ERIC Kra, 




Candl Lavender of Parkland High 
School has found that her partnership 
has helped students associate what 
they are learning In World Hlstoiy with 
real people and real places. Lavender 
says, “My students learned a great deal 
about their partnership country that 
would never have occurred without the 
partnership: Moldova Isn’t on the list of 
countries to cover In World History, but 
by using Moldova as a case study for 
the collapse of the Soviet Union and 
aftermath, students felt they had a 
stake In what happens there. 



“Relevance Is so Important to teaching 
social studies to adolescents, and we are 
not in a vacuum — we are a global com- 
munity. Teachers would not be able to 
do this program without the resources 
and expertise that the ISPT offers.” 

Maiy Alice Lodlco of Tuscola High 
School has moved the communication 
between students from e-mail to face- 
to-face conversations. In the fall of 
1999, teachers and students from 
Nantes, France, visited their partner 
school in Haywood County, and in the 
spring of 2000, students and teachers 
from Waynesvllle went to visit their 
partners In France. 

“Before the French students came to 
live In the homes of their ‘correspon- 
dents,’ writing e-malls was seen by 
some students as simply an assign- 
ment to be fulfilled for a grade, and I 
had to nudge them to send their next 
e-mall,” Lodlco notes. “Most, however, 
looked forward to writing and were Im- 
patient for replies. Now I don’t, and 
can’t, keep track of their exchanges. It 
happens so regularly. . . . Communica- 
tion has taken off, rvlth lots of 
Franglais, but they’re developing lin- 
guistically and forming terrific bonds 
that will become fast friendships after a 
week’s stay in the homes In Nantes.” 

The use of technology Is essential for 
students In ISPT since ail communica- 
tion Is done electronically through In- 
ternet applications. Students and 
teachers are given a real application to 
use the skills they have been required 
to learn for the North Carolina Com- 
puter/Technology Standard Course of 
Study. Partnerships are given webpages 
they may develop for communication 
and publication of student work. 

Following the events of September 11, 
2001, It Is more critical than ever that 
we strive to reduce conflicts and In- 
crease understanding worldwide 
through international education and 
collaboration. Teachers and students 
realize that they do not know as much 
as they should about cultures other 
than their own and have begun to won- 
der what people outside of the U.S. 
think about the U.S. and Its people. 
Students In ISPT partnerships have 
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Teresa Wile's keyboarding students 
at West Bladen High School created 
PowerPoint presentations based on 
correspondence with their partners in 
Hwigary and research they did on the 
Internet She writes that her students 
''...have learned to make group deci- 
sions, take leadership roles, peer 
teach, meet deadlines, and develop 
technology skills . " 

Stephanie Flatt of John A. Holmes 
High School writes, T am really im- 
pressed with the responsibility and 
initiative my students showed in this 
project The detail and rnaturity of the 
reflections showed their eryoyment, 
growth, and learning. " 

Mary W. Evans, a business education 
teacher at South Lenoir High School, 
also writes, "This is a wondeiful 
supplement to the curriculum that 
gives real-world experiences to stu- 
dents that will last a lifetime." 

Thelma Kastl recognizes changed stu- 
dent attitudes: "I have seen this part- 
nership turn many of my students 
from being self-centered to more bal- 
anced. It has also allowed my stu- 
dents who are less vocal and social to 
participate in a project that allowed 
them to communicate and express 
ideas withoutfear." 

One of KastVs students, who origi- 
nally did not see the need to convnu- 
nicate with anyone outside Ids 
community, now says, T found the 
project to be interesting and person- 
ally fulfiUing. It has really changed 
my Ufe. It changes the way you think 
about global events happening when 
you know someone who is personally 
involved. I hope to meet more interest- 
ing people, such as I have in this 
project, during the rest of my Ufe." 





developed an interest in learning more 
so they can develop greater understand- 
ing for themselves and their partners. 

A student from Freedom High School 
working in a partnership with a class 
in Lebanon wrote, “This partnership 
has changed how I think about the 
ways that students in other countries 
think about America.” 

Teachers and students have recog- 
nized that their relationships v^th 
their partners and the new attitudes 
they are developing v^ll continue to 
affect their lives after the partnerships 
are completed. 

James Douglas, a business education 
teacher at Smithfleld-Selma High 
School wrote, “Thanks for making this 
possible. It has been good for me as a 
teacher and, I think, for my students. 

As a matter of fact, I think that my stu- 
dents will benefit for years to come be- 
cause of my involvement this semester.” 

ISPT partnerships have not only 
changed how North Carolina students 
relate to the world — students from other 
countries have also had their horizons 
broadened. Students in India wrote, “We 
were overwhelmed to receive your letter. 
All of us are guessing your probable 
face and figure. The places you all must 
live must be common for you, but it is a 
dream place for us. We were all crowd- 
ing here before your letter..,,” 




A student from China wrote the follow- 
ing to the ISPT coordinator: 



Thanlc you so much to Join us to- 
gether in the Internet over the 
globe, I Just want to represent my 

(eontindd on noxt pagoj 
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(cofltino«d from provioos pojo) 

classmates to say: your work 
means much to us! . . .A few months 
ago our English teacher told us 
we’lljoin the ISPT project. Every one 
of us can’t help but be excited.... It’s 
really like a dream a wondeiful 
dream to us. Now the dream comes 
true: now we can talk with other 
youths all over the world: now we 
can feel and Join our friends’ lives, 
no matter how far we are away 
from them . . . Please believe in us, 
we’ll make full use of the priceless 
chance to communicate over the cul- 
ture, to know the real world by our 
hearts, to let the world know: there 



is an Internet line, which not only 
connect all youth, but also Join 
the wishes of the future! 

More Information about ISPT may 
be found at www.ga.unc.edu. The Inter- 
national School Partnerships 
through Technology Program (ISPTP) 
is a model that other states may 
want to consider. Contact Diane 
Midness of the North Carolina Cen- 
ter for International Understanding 
(412 N. Wilmington Street, Raleigh, NC 
27601, 919-733-4902, (dmidness@ 3 a.unc.edu) 
to discuss the structure and benefits 
of the ISPT Project. 



IVhat It Takes to Develop or Participate 
in a Collaborative lA/eb Project 

Just as the Internet offers multiple sites to join collaborative Web projects, 
Web travelers can also locate sites with suggestions for both designing online 
projects and for successfully participating in an existing project. 

NickNacks Telecollaborate! at http://telecollabofate.net offers not only guidelines for 
designing an online project but ^so provides a template for assessing your soft- 
ware and hardware capability for telecollaboration (NickNacks TeleCheck\, a 
template of the elements of a successful collaborative project (NickNacks Project 
Planner), tips on exchanging files on the Internet and finding participants, and a 
list of websites offering existing projects (http://telecollabofate.net/education/edfind 2 .html). 
One of the strengths of this site is the list of considerations in managing col- 
laborative online projects. These considerations Include the following: 

1. Know your specific hardware and software needs. 

2. Work out the bugs ahead of time. 

3. Test your project on a different computer before soliciting participants. 

4. Clearly state specifics in your call for participants. 

5. Select enough participants to complete project goals. 

6. Determine how to handle too many participants. 

7. Make sure partlcipcints can do what the project requires before the 
project starts. 

g Prartir-p Hata exehange procedures. 




9. Meet the deadlines you set. 

jC* IxCTTiinc! TJiirticiMCirits 3.1bout <5c3.cillncs. 

11 . Encourage and support participants. 

12. Be flexible to the needs of participants. 
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13. Be prepared to go the extra mile. 

14. Complete the project regardless of complications or surprises. 

15. Thank everyone. 

16. Distribute outcomes to all. 

17. Keep in touch. 

18. Have fun. 

(Source: littp://J«lec(i!la!)orate.Bet/»J«tatio''/»JJ»v»lop.litml) 



One of the first sets of guidelines for developing and organizing online projects 
was from Judl Harris In a 1995 The Computing Teacher magazine column, 
“Mining the Internet,” and later In the ISTE publication. Virtual Architecture (c. 
1998). Some of her Ideas on organizing telecollaboratlve projects can be found 
in the archived article at htt|>://lrs,ed,uiuc,edu/mining/February95-TCT,html. She suggests: 

1. Choose the curricular goals. 

2. Choose the activity’s structure. 

3. Explore examples of other online projects. 

4. Determine the details of your project. 

5. Invite telecollaborators. 

6. Form the telecollaboratlve group from those Interested or registered. 

7. Communicate regularly with participants. 

8. Create closure. 



Maybe developing an online collaborative project is more than you want to try 
just now. Instead, start with participating In several of the many projects on 
the Web. When deciding to participate, follow the steps below based on the 
lEARN (International Education and Research Network) guidelines: 

1. Identify a project of Interest and find out if the project Is still active. 

2. Check the “Purpose” and any “Update” topics to correlate them with 
your classroom needs. 

3. Contact the project coordinator to Introduce yourself, your class/ 
school, and reasons for your Interest in the particular project. 

4. Locate the necessary equipment, software, and materials. 

5. Develop a classroom timeline for conducting the project activities. 

6. Organize the students for the activities and in groups for peer editing 
of messages prior to submitting. 

7. Respond to recent postings/topics on the forum. Remember, all 
cfiiHpnK want and need responses to their messages. 

8. Communicate. Even if you can't contribute lor weeks, send a note to 
say so. 

Wlietlieryou decide to develop a collaborative Web project or just participate 
in some of the existing projects, have fun! ♦ 
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Check Them Out: Sources for 
Collaborative Web Projects 



OnllneClass at www.onlineclass.com offers 
Collaborative Online Projects: slx-to- 
ten Interactive learning units In which 
schools (grades 2-9) work In collabo- 
rative groups. Units such as Dino- 
saurs Alive, Bugs Count, The North 
American Quilt, On the Trail with 
Lewis and Clark, We’re Talking Books, 
DoodleOpolls, Blue Ice, and Mythos 
Include a coUaboratlve activity, activi- 
ties for the classroom, Web reading, 
Web links, moderated Web discussion, 
student work displays, and teacher 
support. Pricing for units begins at 
$ 135/school. Also available Is a free 
monthly e-mail newsletter containing 
tips on how to use the Internet In the 
classroom, technology reports, updates 
on OnUneClass programs, and com- 
ments from educators using the Inter- 
net In the classroom. 

The Quest Channel from Classroom 
Connect at http://quest.classroom.com offers 
standards-drlven. Interactive geo- 
graphic expeditions and travel with a 
team of experts, adventurers, and stu- 
dents to solve mysteries around the 
world. Team leader, Dan Buettner, Is a 
familiar figure to long-time Internet- 
using educators from his early adven- 
tures In MayaQuest and AfricaQuest. 
Past quests and resources are available 
when you subscribe to the current 
quest. Most past expeditions have tar- 
geted upper elementary through high 
school students. 

The Stevens Institute of Technology 
offers collaborative K-12 science 
projects at http://k12science,ati,steuens-tech,edu/ 
collabprojs.html. The projects, correlated 
with the National Science Education 
Standards, are designed and managed 
by the Center for Improved Engineering 
and Science Education (CIESE), lo- 
cated at the Stevens Institute of Tech- 
nology. These free projects primarily 
focus on middle school science curricu- 
lum but include projects in math, sci- 
ence, and educational technology for 
grades 1-12. Each project has a 



similar structure with a project de- 
scription, project Instructions, project 
data, student area, teacher area, ref- 
erence material, and online help. The 
projects are correlated with the National 
Science Education Standards. 

Global SchooINet Foundation Is the 
“tried and true” source for online col- 
laborative projects. They have offered 
free coUaboratlve learning activities since 
1984. Located atwww.globalschoolnet.org, the 
site’s Projects Registry is a clearing- 
house of projects from around the 
globe, some hosted by the Global 
SchooINet Foundation and others by 
reputable organizations and by class- 
room teachers worldwide. Users can 
search by student age, project start 
dates, curriculum, technology, or level. 
Also available are online, real-time ex- 
peditions for students to join a saUlng 
ship, climb a Peruvian Andes peak, or 
travel around Africa or Australia. 

The Project Center at www.eduplace.com/ 
projects from Houghton Mifflin Company 
is filled with collaborative Internet K- 
12 classroom projects submitted by 
educators for mathematics, science, 
social studies, and reading/language 
arts classrooms. The Project Center 
also Includes a guide for creating your 
own online project and a form for sub- 
mitting the project for posting. There is 
no charge for participating either In an 
existing project or for submitting your 
own project for others to join. 

Some sites with links to other website 
collections of coUaboratlve online 
projects include the following: 

♦ Kentucky Educational Television: 

www.ket.org/Edueation/IN/projects.html 

♦ Judy Harris’s book: 
http://ccwf.cc.utexas.edu/~jbharris/Virtual- 
Architecturo (click on Curriculum-based 
Telecommunicating Projects & 
Resources) 
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Adult Literacy Students Explore 
Antarctica Virtually 



Adult basic education and ESL learners in Elizabethtown, 
North Carolina, have been writing to and learning from an 
adult literacy teacher in Antarctica. Leigh Thompson, Direc- 
tor of the Bladen County Literacy Council and a teacher in 
the program, is participating with her adult learners in a 
NSF-sponsored electronic fieldtrip to learn about Antarctica 
and the research that is being done there. They are looking 
at maps, reading about Antarctica, thinking about what it 
would be like to be there, and having answers to their ques- 
tions come back from Antarctica. 

Susan Cowles is an adult educator from Corvallis, Oregon, 
spending two months on a scientific research expedition study- 
ing Persistent Organic Pollutants (POPs) at Palmer Station, 
Antarctica. Every day or two, she posts a new Journal entry 
and pictures to the expedition’s website at htt|K//tea.rice.e(lu/ 
tea_cowle$frontpage.html and encourages adult learners to e-mail her. 
Thompson reports that the learners have been particularly in- 
terested in the terrain, Uvlng conditions, her dally activities, 
and whether she has been homesick. 

Tanisha, a new reader, wanted to ask about who else lives at 
the site and where they get food and clothing, but like many 
adult learners, she was hesitant to type her questions into an 
e-mail, perhaps because of a lack of confidence In writing 
skills as well as technophobia. Thompson offered to type from 
dictation, and the message was sent. A day or so later, 
Tanisha was ecstatic to find a personal response to her ques- 
tions and then eagerly typed additional questions herself. 

“One of the best things about our participation in this 
project,” says Thompson, “is that it gives the students an 
opportunity to learn about the Internet and about e-mail by 
actually getting to send mall to someone who is very far 
away, who is interested In their questions, and who sends a 
reply almost immediately.” ♦ 
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♦ TheNJNIE Project: 
htip://kt2$cience.ati.$teven$-tech.edu/training/ 
findingprojecta.html 

♦ The Math Forum/Drexel University: 
http://mathforum.org/workshops/sum96/ 
data.collections/datalibrary/lesson. ideas.html 

♦ Computer Pals Across the World 
site from the University of Central 
Florida: http://reach.ucf.edu/ ~ cpaw 

♦ Elsenhower National Clearinghouse: 
www.enc.org/weblinks/classroom/projects 

4 Blue Web’n: www.kn.pacbell.com/wired/bluewebn 

♦ Interactive projects for K-12 from Youth Net: www.youth.net/weleome.html#K-t2 

Electronic mailing list archives, such as EDTECH (www2.h-net.msu.edu/~edweb) or 
WWWEDU, often advertise other online collaborative opportunities, as well as 
those sponsored by professional organizations such as the National Council of 
Teachers of Mathematics (www.nctm.org). Nearly any class or school project can be 
turned Into an online collaboration with a website, e-maU, and a little imagina- 
tion. So, check out the sites above, not only for participation, but also for Ideas 
about how to turn your favorite project Into a collaborative online project! ♦ 
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Is a computer for every student — a 
laptop or even a ratio of one desktop 
computer per student— still a dream 
for most schools? Across the South- 
east, the response would be a re- 
sounding, “Yes!” Several schools, 
however, are testing handheld com- 
puters, such as Palm's Palm Pilots 
and Hewlett Packard’s Jornadas, as 
possible technologies to provide each 
student. Many high school students 
already own a graphing calculator 
that costs about the same amount as 
many of these handheld devices. So 
why provide a student a handheld 
computer? In addition to being a 
graphing calculator, a handheld com- 
puter can serve as a time-manage- 
ment tool, a graphic organizer, a word 
processor, a web browser, an e-mail 
device, and much more. 

Originally marketed as a personal 
organizer for on-the-go business 
executives and ardent technophiles, 
personal digital assistants (PDAs) 
have evolved into handheld comput- 
ing devices and have become one 
of the most ubiquitous electronic 
devices in both the consumer and 
business worlds. Sometimes 
known as PDAs, palmtops, pocket 
PCs, personal PCs, handheld de- 
vices, or handheld computers, 
these devices were described in 
the Chicago Tribune as looking like 
a “cross between a cell phone and 
a Nintendo Game Boy.” 

Due to lower costs, increased func- 
tionality, and the availability of new 
software designed specifically for 



education, K-12 schools are begin- 
ning to take a serious look at hand- 
held computing for teaching and 
learning, administrative tasks, and 
communication and collaboration. In 
fact, the potential for using hand- 
helds in education is almost limit- 
less. Now is the time to begin 
discovering whether or not these 




computing devices can be used to 
help fulfill the promise of educa- 
tional computing. They Just may be 
the answer to overcoming the prob- 
lem of access to technology and to 
creating equity of use in the class- 
room. This issue of the SEIR^TES 
NewsWire is devoted to exploring the 
possibilities of handheld computing 
in K-12 schools. ♦ 
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The Impact of Technology 
on Education 




Although it is difficult to generalize find- 
ings from technology research, there 
should be little question that technology 
has an important role to play in educa- 
tion. Ask any teacher who really uses 
technology effectively in the classroom. 
Ask students who use technology as a 
tool in their own learning. They’ll con- 
firm what the research (Valdez et al., 
2000) says: 

♦ Technology makes learning more in- 
teractive. more enjoyable, and more 
customizable. It improves students’ 
attitudes toward content and their 
interest in learning. 

♦ Technology offers opportunities for 
learner -control, increased motivation, 
and connections to the real world. 

♦ Technology can improve student 
achievement — as indicated by in- 
creases in standardized text scores — 
when it is used to support instruction 
in the classroom. 

♦ Technology can help students investi- 
gate and answer complex questions, 
develop thinking skills, and learn to 
access, sort, evaluate, and synthesize 
information. 

♦ Technology can help students set goals, 
form and test hypotheses, and make 
discoveries on their own — whelping them 
develop skills they will encounter in life 
after school. 

♦ Technology offers tools to share knowl- 
edge and learn cooperatively instead of 
individually. 

♦ Technology can make students more 
efficient and organized. 

♦ Technology can help students clarify 
their questions, locate potential an- 
swers, and decide on validity, appro- 
priateness, and perspective. 

♦ Technology can be a powerful tool for 
assembling, modifying, assessing, and 
studying information; manipulating 
data; and generating new knowledge 
and deep understanding. 

♦ Technology enables learners to commu- 
nicate in new ways with their peers. 



with experts, and with others around 
the corner and around the world. 

Many studies, however, have shown 
technology has not had a great impact on 
teaching and learning. Why not? There 
may be many reasons, but lack of access 
to technology seems to be among the top 
culprits. In a study conducted by Elliot 
Solo way and the Hi-Ce project at the 
University of Michigan. 50% of the 6,000 
respondents (teachers) to a survey re- 
ported that their students use computers 
less than 15 minutes a week (Soloway et 
al.. 2000). Why? Sixty percent of the 
6,000 respondents reported that they 
had one or no computer in their class- 
rooms. Neither they nor their students 
have access to computers for any ex- 
tended period of time. According to 
Soloway and his colleagues. “It’s unrea- 
sonable to expect computers to have a 
positive impact on learning and teaching 
[when students and teachers] have lim- 
ited access to them and thus aren’t using 
them” (Soloway et al.. 2001). 

While every student cannot be provided 
with a $1,000 desktop computer, it is not 
outside the realm of possibility to imag- 
ine a time when every student can be 
provided with his or her own $100 per- 
sonal handheld computing device. These 
affordable devices could overcome the 
access barrier that is limiting the impact 
of technology on teaching and learning. 
Time will tell the story. ♦ 
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Handheld Technology: The Basics 




What is a Handheld Com)>uter? 

Handheld computers include those devices originally referred 
to as personal digital assistants (PDAs) and others that have 
evolved from that concept. These devices now offer many more 
computing functions than the original PDAs, which mainly in- 
cluded calendars, address books, and “to do” lists. These devices 
range in size from those that fit into one hand and use a stylus 
for input to those with keyboards that are approximately to Va 
the size of a typical laptop. The term palmtop is occasionally 
used — referring to the natural progression from desktop to lap- 
top to palmtop — however, palmtop can be confused with the 
brand name Palm^^, so now the more popular term for these 
devices is handheld computer or handheld device. 



How They Evolved 

Apple Computer, Inc. developed the 
Apple Newton^^ in 1993. The company 
introduced it as the first PDA and sold it 
as the ultimate information appliance. 
John Sculley, former chairman of Apple, 
predicted PDAs would become ubiqui- 
tous tools that would hold telephone 
numbers, keep calendars, store notes, 
and send and receive data wirelessly. 
Unfortunately, the Newton was ahead of 
its time and did not find a market large 
enough to survive. 

In 1996, Palm, Inc. delivered the first 
truly successful handheld computer, the 
Palm Pilot. This device helped people or- 
ganize their lives by providing instant, 
anytime access to schedules, important 
phone numbers, addresses, “to do” lists, 
and other key information. The business 
world quickly embraced the small and 
powerful Palm handhelds. 

Because of the popularity of the Palm 
Pilot, several other manufacturers began 
releasing their own PDA devices. These 
devices utilized a new operating system 
from Microsoft called Windows CE, which 
was basically a scaled-back version of 
the Windows desktop environment. The 
most recent version of Windows CE is 
now called Pocket PC. 

Most of the producers of PDA-type de- 
vices are trying to encourage the public 
to think of these devices not as PDAs but 
as handheld computers. Many producers 
are not only adding on computer-type 
capabilities but also combining their de- 
vices with other electronics, such as 
wireless phones, cameras, and probes. 

O 





How They IVork 

Operating Systems — ^While there are many 
handheld manufacturers in the market 
these days, there are really only two ma- 
jor operating systems in direct competi- 
tion at the time of this publication: the 
Palm OS, (used by Palm, Handspring, 
and Sony manufacturers to name a few) 
and Windows CE/ Pocket PC (used by 
Hewlett Packard, Compaq, Casio, NEC, 
Toshiba, etc.). In general, the Palm OS 
represents a more basic approach, and 
the devices are cheaper. The Windows 
CE/Pocket PC system is more robust, 
and the devices are generally more ex- 
pensive and, due to their more complex 
system, require more technical support. 
Currently, handheld devices using the 
Palm OS have approximately 75% of the 
market shsire; however, there are advan- 
tages and disadvantages to both operat- 
ing systems, and the decision to use one 
or the other depends upon users’ needs. 
Other handheld operating systems being 
used today include Symbian, used in 

(eontinaed next page) 
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Expansion and Peripherals: 
Adding On 



The original handheld devices were most often 
used exclusively as personal data assistants 
(PDAs) to hold telephone numbers and addresses, 
keep calendars, and store notes. Manufacturers 
began to realize the benefits of adding peripherals 
to increase the functionality and desirability of 
the simple PDAs. Below is a listing of some of the 
devices available for handheld computers. 

^ Portable keyboards: 

♦ Palm OS compatible resources 
<> www.palm.com 

O www.targus.com 
^ www.seiko.com 

# www.landware.com 
^ www.fellowes.com 
^ www.ibizcorp.com 

♦ Windows CE compatible resources 

^ www.landware.com 
^ www.ibizcorp.com 
O www.hp.com 
^ www.targus.com 

4 Digital camera attachments: 

♦ Palm OS compatible resources 

www.eyemodule.com 
^ www.kodak.com 

# www.sonystyle.com/micros/clie 
O www.targus.com 

♦ Windows CE compatible resources 

www.casio.com 
^ www.nexian.com 

4 Optical accessories (barcode 
scanners): 

♦ Palm OS compatible resources 

# WWW.symbol.com 

♦ Windows CE compatible resources 
^ www.socketcom.com 

4 Wireless telecommunications 
accessories (modems and devices): 

♦ Palm OS compatible resources 
^ www.palmgear.com 

^ www.novatelwireless.com 
^ www.synchroscan.com 
^ www.red'm.com 
^ wwwt.sprintpcs.com 

# WWW.handspring.com 

♦ Windows CE compatible resources 

# www.pretec.com 
www.novatelwireless.com 

^ www.targus.com 

# Accessory to connect handheld to 
digital projector or VGA display: 

♦ Palm OS and Windows CE compatible 
^ www.margi.com 
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cellular phone technology; RIM, used in the 
BlackBerry™ line of handheld devices; and the Psion 
EPOC system. 

Input — ^There are a number of options for entering data 
into a handheld, depending on the model: 

♦ Onscreen keyboard— The user punches letters 
and numbers on an onscreen representation of a 
standard keyboard. 

♦ Character recognition program — ^The user 
“handwTites” data using the stylus (e.g.. Graffiti for 
Palm OS and Character Recognizer for Windows 
CE/Pocket PC). 

♦ Synchronizing — Since handhelds don’t have floppy 
drives to transfer data and programs, they must be 
“synched” with a desktop/notebook computer. This 
is done with a program installed on both devices 
(HotSync for Palm OS and ActiveSync for Windows 
CE/Pocket PC) and a connection between the de- 
vices. Depending on the model, this can be done 
using a cradle, a cable connection, or wirelessly. 
During synching, schedule and address book infor- 
mation, e-mails, and other specified data are 
shared between the devices. Synching is also used 
to install new software on a handheld device. 

♦ Memory^stick — ^The latest models of the Palm OS 
technology allow data to be shared through mem- 
ory sticks. These postage-stamp-size memory 
modules can be easily inserted into the handheld 
unit for access to pre-recorded applications and 
data or used to store additional data cis one would 
with a floppy disk or CD-ROM. 

♦ Infrared port — Most handhelds have an infrared 
port that allows users to “beam” or wirelessly 
transfer programs and data between handheld 
devices. The infrared port is considered by many 
to be a major advantage in educational use. This 
process requires a fairly close proximity between 
the devices and a clear line of sight. 

♦ External keyboard— There are many models that 
attach to handhelds to allow full-size typing 
capabilities. 

♦ Other peripherals — Data can also be input with 
probes, modems, network cards, cameras, and 
many other add-on peripherals. 

Output — ^There are also many ways to output data 
from handhelds: 

♦ Screen — Screens are the most common output 
method for handhelds, and they vary widely in size, 
resolution, and readability. 

♦ infrared port — See Input above. 

♦ Synchronizing — Data can be sent from the 
handheld back to desktop computers for further 
manipulation. 

♦ Peripherals — Data can be output to peripherals, 
such as memory sticks, modems, network cards, 
and printers. ♦ 
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An Overview of 
iVireless Networking 



One of the advan- 
tages of handheld 
technologies is 
their mobility. 
However, in order 
to be truly “mo- 
bile,” it is im- 
portant to think 

about Internet access, and this leads us 
into the world of wireless communications. 

In general, wireless is a term used to re- 
fer to network-type communications that 
take place without physical connections 
(wires), but there are many types of wire- 
less access. 

One type of wireless is cellular, which is 
the same technology that is used with 
mobile phones. This type of wireless com- 
munication is typically used to facilitate 
long distance communications, such as 
phone calls. Examples of this type of wire- 
less use Include mobile phones, pagers, 
BlackBerryTM devices, and Internet access 
via a handheld, such as a Palm or Hand- 
spring device. This type of service typi- 
cally Incurs a monthly service fee, which 
can range from $20 a month and up, de- 
pending on the nature of the service. 
Handhelds that use this technology in- 
clude Palm’s 1705 handheld. Handspring’s 
Treo communicator, and various other 
devices and add-on modules that have 
wireless modems. 

Another type of wireless 
can be used to facilitate 
localized communica- 
tions. Typically, this type 
of wireless allows a de- 
vice, such as a computer, 
to connect to a LAN v^th- 
out a cable connection. 

An important thing to 
note about this technol- 
ogy is that it goes 
through wails and up 
and down stairs, so there 
aren’t the line of sight 
issues that exist with in- 
frared technology. 




There are three main va- 
rieties of this technology: 



Bluetooth^^ — Bluetooth is a wireless 
solution with a 30-meter radius range. 
Bluetooth works well for hard cable re- 
placement, and, therefore, printing is 
likely to be the most Important Bluetooth 
application. Bluetooth supports Ethernet, 
but because of its slow speed, it is not a 
typical use. Bluetooth supports voice, 
and this flexibility is likely to yield some 
popular applications that relate to auto- 
mated phone switching between cellular 
and land-line service. Bluetooth is also 
likely to be the technology used to enable 
cashless vending machines and other 
purchases through cell phones or other 
Bluetooth-enabled devices. There are 
new Bluetooth cards available for Palm 
handhelds, and some of the early appli- 
cations for these are geared toward 
document collaboration. 

802.1 lb (also knovra as Wi-Fi or wire- 
less Ethernet) — 802.11b is a protocol 
used for wireless networking. It is great 
for locations like older school buildings 
that are difficult (or expensive) to wire. 
The range for this technology is typically 
150-300 meters in radius and supports 
up to 1 1 megabit data rates, which is 
very fast for Internet access and other 
applications. This is the 
technology that Apple is 
using for its AlrPort sys- 
tem, which is very popular 
with schools. Xircom (a 
division of Intel) makes Wi- 
Fi modules for a variety of 
handhelds. Some Pocket 
PC handhelds come with 
Wi-Fi capability built-in. 

Home RF — ^Thls is a wire- 
less networking protocol 
similar to 802. lib that is 
compatible with Ethernet 
but is considerably slower 
at 2 megabit. One advan- 
tage of Home RF is that it 
is designed to carry voice 
data. However, it is waning 
in popularity and is not 
currently compatible with 
Macintosh computers. 

(continued next page) 
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There are two basic configurations that 
can be used for local wireless access — 
peer-to-peer and infrastructure. Peer-to- 
peer does not require a central access 
point; it works from device to device. In- 
frastructure uses a central access point 
or base station that connects to the net- 
work and can serve multiple devices 
within the specified radius. 

802.1 lb supports both peer-to-peer and 
infrastructure use, but it is typically 
implemented as infrastructure. In order 
to set up 802. 1 lb in this way, two types 
of hardware are typically used: a baise 
station or access point and a device card. 
There may be one or more access points, 
depending on how large the service area 
is. The device card goes into each device 
(computer, handheld, etc.) that is to have 
wireless access. Typically, these device 
cards are in the form of a PC card or 
other similar device. Access points can 
cost from $179-$500 and up. Device 



cards are typically around $100-$400 
each. Prices are expected to drop as the 
technology matures and economies of 
scale are achieved. 

Bluetooth was designed to use peer-to- 
peer communications and is typically 
used this way; however, recently, the 
notion of an access point has been 
added for Bluetooth installations. 

It is important to know that these vari- 
ous protocols are not compatible with 
each other. It is also important to recog- 
nize that within one type of technology, 
not all access points are compatible with 
all device cards. Because this is an 
emerging technology, compatibility test- 
ing of components is vital. ♦ 



©K12 Handhelds Copyrighted by K12 
Handhelds. May not be reprinted without written 
permission from K12 Handhelds, 
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Resources for lA/ireless Networks in Schools 



Becoming a Wireless Campus — www.thejournal.com/maga2ine/vault/A3482.cfm 
Bluetooth Group — www.bluetooth.com 

eSchoolNews Report on Wireless Networking (free, but requires a sign-up ] — 
www.e$ehoolnews.eom/resources/reports/wireless0801 

Three Reasons to Consider Wireless Networking — 
www.e$ehoolnews.eom/news/$how$tory.cfm?ArtielelD=1460 

WiFi-WECA site — www.wi-fi.org 

Wireless Laptops and Local Area Networks — www.thejournal.com/maga2ine/vault/A3536.cfm 
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24 BEST COPY AVAIUBLE 




If you are thinking about buying a handheld, here are some technology considerations 
to keep In mind as you make your decision. 



Size, lA/eight, Appearance 



□ How will you be carrying your handheld? Pockety briefcase^ purse? Since 
portability is the key advantage of handhelds » the device should be light and 
small enough so that you will take it with you. (If you are going to take it with 
you, does it have a case to protect it while not in use?) 

□ Handheld technologies vary from palmtop size to those roughly half the size of a 
laptop with a built-in keyboard. Which form factor makes the most sense for 
your use? 

□ Is the appearance (color and design) of the 
handheld device important to you? 



Changeable Battery vs. 
Cradle-Charging System 



Which is best for your specific situation? 

□ Some devices use a number of batteries, 
such as AAA, and you should always carry 
extras when traveling. 

□ Others contain rechargeable batteries that 
get their charge when the device is plugged 
into the cradle or optional portable charging 
adapter. 

□ Consider the average battery life. 



Capability vs. Ease of Use 



Which operating system will suit your needs? 

□ In general, devices using the Palm operating 
system are less expensive and simpler to use, 
but Include less built-in multimedia 
capabilities. 

□ Devices using the Pocket PC operating 
system are more expensive, may be more 
complex to use, and may require more 
technical support; however, they include 
more functiongility including built-in 
multimedia support. 

□ Consider which platform most of the peers 
with whom you will possibly be sharing data use. 




Memory 



How much memory dues Uie device have? 

□ For Palm OS devices, 8 MB will be adequate for most users. Pocket PC device 
users will require more memory because of the operating system requirements. 



□ Is the memory upgradeable if it becomes necessary? 

ebIc ^ 
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Available Software 



Screen Display 




What do you want to do with your 

handheld? 

□ Just as with desktop computers, 
the real power of handheld devices 
comes from the software applications 
you are able to add. 

U In terms of sheer volume, the Palm 
OS is the clear leader, with the 
software library for Pocket PC 
slowly improving. It doesn’t matter 
how many programs are available, 
but whether or not the programs 
you need are available. 

□ Basic desktop-type programs (data- 
bases, presentation tools, document 
readers, etc.) are generally available 
on both platforms; however, as you 
start to look for more specialized 
applications. Palm OS devices have 
the advantage again. 



Is color display Important to you? 

□ With most handheld devices, color 
displays are more readable, but 
monochrome displays require less 
power so batteries last longer. 

□ What is the screen resolution? 
Active Ma.trix color screens are 
typically higher in resolution and 
richer in color, depth, and 
brightness in various light 
conditions. 

□ Does the handheld have a 
backlight? 

□ How “readable” is the screen? 

□ Where will you be using this device 
most of the time? Be sure to 
consider the lighting conditions 
(Indoor under different lighting, 
outdoor in direct sunlight, etc.). 



Peripherals 



1 



Cost 



What kind of peripherals do you need? 

□ Do you need digital cameras, 
modems, telephones, wireless 
Ethernet expansion, bar code 
scanners, projection modules, 
scientific data sensors, etc.? 

□ Is the device Internet capable? 
Internet capability may be added 
through landline or wireless and 
may be built-in or added through 
expansion. 



What is the cost of the handheld? 

□ What are the up-front purchase 
costs of the handheld device? 

□ What are the costs for related 
things like software, expansion 
modules, and accessories? 
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References for Buying Handhelds 



Buyer’s Guide to Handhelds. (2002). ZDNet Reviews. 

Retrieved from www.zdnet.com/products/stories/reviews/0, 4161, 2585429, OO.html. 

CNET Handheld Buying Advisor. (2002). CNET. Retrieved from 

http://computeM.cnet.coin/hardware/0-5048347-7- 
6163347.html?tag = st.co.14448.bhed.5043347-7-6163347. 

CMET Handheld Hard\v?j*^ Reviews. (20021. CNET. Retrieved 

from http://computers.cnet.eom/hardware /0 14448.html?tag—st.co.t087.more.t4448. 

PDA Buyer’s Guide. (2001, November). pdaED.com. Retrieved from 
www.pdaed.com/verricai/turoria 1 s/ouyefs 9 uida 2 .xm!. 

What to Look For in a Handheld. (2002). CNET. Retrieved from 

http://computers.cnet.eom/hardware/0-2645869-7-1480993.html7ta9 =dir. 
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Educational Advantages 



Why are educators considering purchasing handheld technologies for school use? 

The educational advantages of handhelds over full-stzed, varied-functioning comput- 
ers range from cost to size to ease of use. The list below is a good initial set of reasons 
to consider handheld devices for your school. 



I ♦ Cost — Handhelds usually range in 
price from as low as $100 to as 
high as $1,000 depending upon the 
capabilities. A basic handheld for the 
typical student can be found in the 
$100-$300 range, with educational 
discounts available for large 
quantities. 

♦ Mobility — This is possibly one of the 
biggest advantages, since handhelds 
can be taken practically anywhere 
instead of being confined to the lab or 
classroom. Because there is no need 
for electrical connections while it’s 
being used, it can be used outside or 
while traveling. 

♦ Wireless — ^The ability to transfer or 
share data and programs wirelessly 
overcomes the need for a more hard- 
wired infrastructure and adds to the 
mobility. 

♦ Size — ^This really provides a number of 
benefits: 

<l> Physical storage of devices — 
Because of their small size, it’s 
not necessary to have a separate 
lab for a classroom set. 

^ Media storage — Devices can be 
loaded with electronic versions of 



large reference materials in a 
portable format. 

# Ubiquitous access — Users can carry 
them in pockets, backpacks, 
purses, and briefcases and always 
have access to information and 
programs. 

♦ Ownership — Because of the feeling of 
ownership, along with the “cool 
factor,’’ students take care of the 
devices so they don’t lose the 
privilege of using them. 

♦ Access — Because of the relatively low 
cost, entire classroom sets of hand- 
held devices can be purchased for 
the price of three or four desktop 
computers and can provide access to 
many more students for much longer 
time spans. 

♦ Collaboration and Sharing — Beaming has 
been found to be an extremely 
effective technique for encouraging 
students to work together and share 
information. 

♦ Simplicity/Ease of Use — Particularly 
with the more basic educational 
applications, teachers do not have to 
spend a lot of time teaching students 
how to use them. ♦ 




References for Educational Advantages 



Pfeifer, R. S. (2001, May). Beaming your school Into the 21st century. [Electronic version] 
Principal Leadership (High School Ed.), J(9), 30-4. Retrieved from WWW.principals.org/news/ 
beamin 3 seh 00 l.html. 

Along with examples of uses of handheld computers In a Maryland high school, 
a number of advantages of using handheld computers are discussed. 

Soloway, E. (2001, April). Making palm-sized computers the PC of choice for K-12. 
[Electronic version]. Learning and Leading with Technology, 28(7), 32-34, 56-57. 
Retrieved from www.iste.org/L&C/arehiyfe/yfol28/no7. 

Describes how palm-sized computers, ouuilleu willi suitable &unvvcuC, c«.n pro^’ldc 
the K-12 community with personal, pervasive access to networked computational 
resources to support student learning. The benefits of using palm-sized computers 
to support collaboration, charing, and revision are discussed 
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Educational Concerns 

Introducing handheld technologies into the school program has some potential concerns. 
These technologies may be small, but small does not always mean simple and easy. Con- 
sider the issues below before deciding that handheld technologies are right for your school, 



♦ Compatibility — Palm OS and Windows 
CE/Pocket PC devices are not 
compatible. While some data can be 
interchanged, programs cannot. The 
other compatibility issue comes into 
play when a desktop computer is 
involved. While some programs support 
both desktop platforms, in general, 
more handheld applications are written 
to work with Windows desktop 
computers than with Macintosh. 

♦ Cheating — By using an infrared port 
similar to that of a TV remote control, 
handheld computers can beam infor- 
mation to other handhelds. This al- 
lows students to share information 
easily, but it also raises the possibility 
of cheating since students can beam 
answers to each other. Fortunately, 
with most handhelds, there are ways 
to restrict beaming for this very rea- 
son. With these unique concerns in 
mind, your school may want to revisit 
acceptable use policies to ensure that 
potential issues are addressed. Most 
guidelines applied to the use of the 
Internet and classroom computers 
can be adapted to the use of wireless 
handheld technologies. 

♦ Distraction — ^The very versatility of 
handheld devices also makes them 
highly conducive to off-task behavior, 
such as game pla}^ng or Web surfing. 

♦ Effectiveness/Research — At present, we 
don’t really know how the use of 
these devices affects student achieve- 
ment. They haven’t been around long 
enough for many extensive studies. 

♦ Infrastructure — ^Although handheld 
computers are not expensive, peri- 
pherals such as keyboards, cameras, 
cases, styli, and hardware modules 
must also be purchased. Decisions 
about who needs what equipment 
must be made. Software must be 
added and regularly upgraded. 

♦ Ownership — Who will own the 
handhelds? Students or schools? 

♦ Professional Development—What resources 
are available for training both student 



and staff on the proper and effective 
use of handheld technologies? Even 
though handhelds tend to be less 
complicated in use, a level of profes- 
sional development and orientation is 
required to fvlly utilize the technology. 

♦ Replacement Issues — ^TTiis includes con- 
cerns about durability and warranties. 

♦ Safety — Little is known about the 
handheld computer’s possible impact 
on students’ health, such as 
eyestrain and carpal tunnel effects. 

♦ Screen Readability — Even the largest 
handheld device has a small screen- 
viewing area. The issues here really 
revolve around the intended use of 
the device (extensive reading vs. 
quick formula calculation), the 
physical location of its use (lighting), 
and the age of the user. 

♦ Screen Size — Not Just readability of text 
but also many graphics, such as 
charts and graphs, do not translate 
well to the small size screen. 

♦ Security — ^There are a number of 
security issues involved: 

# Theft — One of the biggest advan- 
tages of handhelds — their size — 
also makes them prone to theft. 

^ Data — Developers are scrambling to 
build in data security safeguards 
like those in place for desktop 
computers, but it’s a new field, 
with new concerns. 

^ Viruses — ^Yes, they exist for hand- 
helds, too. Although not in the 
large numbers experienced by 
desktop users, viruses are 
increasing, and virus protection 
programs for handhelds are 
becoming more popular. 

j ^ Tec!i Support — They need to be 

fixed in a timely manner for effective 
use. On the plus side, it’s not too 
expensive to have some ’Toaners” 
available as a quick fix, which isn’t 
really a viable option with larger, 
more expensive desktop models. ♦ 
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References for Educational Concerns 



Pownell, D. (2001, June). Getting a Handle on Handhelds. Electronic School Retrieved from 

www.eleetronie-sehooLcom/ 200 t/ 06 / 060 tkandkeld$.ktml. 

Suggests questions to ask about leadership, teaching and learning, staff develop- 
ment, technology support, planning. Infrastructure, safety, ethics, evaluation, 
security, curriculum, change, and equity regarding the use of handheld computers 
In the classroom. 

Robertson, S. I. (1997, July). The use and effectiveness of palmtop computers In education. 
British Journal of Educational Tf^chnology, 28. 177-189. 

Researchers present a few problems educators found when using handhelds In the 
classroom (screen size, limited memory, theft of device, lost flies, lack of training). 



Student Teachers and High School 
Seniors Beam the Internet 



Seniors in an English class at New Hanover High School (NHHS) In Wilmington, 
North Carolina, have a totally different approach to Senior Project papers and stu- 
dent teacher Interns. As part of the Technology for Reflection and Assessment Coali- 
tion, a Preparing Tomorrow’s Teachers to Use Technology (PT3) grant at the Watson 
School of Education at the University of North Carolina at Wilmington (UNC-W), the 
NHHS seniors used the Hewlett Packard Jornada handheld wireless technology to 
collect and organize Information for their assigned papers. 

Amy Hawk, one of the student teacher Interns from UNC-W, used 30 Jornadas 
with her senior English class. The seniors used the Jornada’s word processing 
application and Its wireless Internet connection to develop a letter of Intent on 
the research paper topic, conduct Internet research on the topic, participate In 
class literature research activities, and produce a final product. With the capa- 
bility to beam their work to the school network and to access the Internet 
wirelessly whenever they wanted, the students completed their Senior Project 
papers In less time than their counterparts who used the school computer lab. 
Ms. Hawk also used the Jornadas with her sophomore English class. They used 
the Jornadas for word processing and Internet research as well as for class ac- 
tivities to create their own Anglo Saxon riddles. 
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Using the handheld technology In the English classes was a new but exciting experi- 
ence for the student-teacher intern and Is one of the UNC-W PT3 project goals of 
accelerating the Infusion of technology throughout the teacher preparation program. 
Ms. Hawk reported that, for the students, the handheld devices were efficient and 
effective ways to manage their research and writing time and to provide greater ac- 
cess time to the Internet than using the one 
school computer lab. For her as a student- 
teacher Intern, the devices provided Instant 
availability to search the Web during class ac- 
tivities and an Incentive to Incorporate technol- 
ogy Into her teaching. She noted that it is 
Important that school administrators support 
usl»^g handheld technologies In teaching and 
learning and believe that students will benefit 
from the experience. This was certainly true at 
New Hanover High School, and It was a factor 
In the success of the project. ♦ 
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Administrative Applications 

1 . Keep your schedule 

2. Track student progress on specific 
skills 

3. Conduct authentic assessment 

4. Use a calculator 

5. Make a database of key content and 
concepts for student use 

6. Take attendance 

7. Instantly access student 
information, such as schedules, 
demographics, or parent contacts 

8. Organize your reading lists 

9. Take notes at a meeting 

10. Record and tabulate grades 

11. Track computer hardware and 
software inventory 

12. Enhance school safety with bar code 
passes 

13. Access lesson plans 

14. Use a rubric to assess and score 
student work 

15. Access a database of curriculum 
standards and related curriculum 
resources 

16. Keep an inventory of books and 
materials 

17. Store and track student lEPs 

18. Track technical support requests 

19. Keep a list of all your Important 
contacts 

20. Evaluate student teacher perfor- 
mance and record observation notes 



21. Access a library book list 



22. Track, organize, and control 
inventories and safety information 
for chemicals in the lab 

23. Let students have constant access to 
their current grades (veiy 
motivating!) 

24. Track teacher recruiting activities 

25. Access human resources benefits 
information 

26. Look up technical troubleshooting 
information 

27. Keep emergency procedures and 
checklists readily accessible 



Communication and Collaboration 
Applications 

28. Send an e-mail 

29. Schedule school meetings as a group 

30. Collaborate on a graphic organizer 

3 1 . Send a fax 

32. Make a presentation 

33. Make a phone call 

34. Distribute school activity 
information to students and parents 

35. Send assignment information home 
to parents 

36. Exchange information with a 
colleague 

37. Have students beam in an 

! assignment 

38. Get parents’ sign-offs 

i 39. Share a downloaded Web page with 
i someone 
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40. Transfer a file from your PC for 
Instant access 

41. Write an eBook and share it with 
others 

42. Track and exchange data on team 
activities 

43. Receive instant messages 

44. Conduct group writing activities 

45. Record voice notes 

46. Transmit close captioning of lectures 
for the hearing impaired 

47. Access online educational events 



Teaching and learning Applications 

48. Take and store digital photos for a 
report 

49. Make a spreadsheet 

50. Draw a picture 

51 . Make a concept map summsirizing a 
chapter 

52. Form, visualize, and solve equations 

53. Keep track of your class schedules 

54. Take notes on a field trip 

55. Read an eBook 

56. Find locations with a GPS 

57. Take field notes by GPS location 

58. Graph data 

59. View maps 

60. Organize your assignments 

61. Gather data on temperature, light, 
voltage, pH, and more with data 
probes 

62. Program your own handheld 
application 

63. Give (or take) a quiz 

64. Look up a word in a dictionary 

65. Use flashcards 

66. Use a tutorial for self-study 

67. Do homework 

68. Write a report 

69. Take notes in class 

70. Complete a worksheet 

71. Study a foreign language 

72. Listen to reenactments of historic 
speeches 

73. Play a game that simulates the 
transfer of viruses 

74. Do research on the Web 

O 




75. Send and receive individual or class 
questions 

76. Gather data on transportation use, 
food Intake, and energy use to gauge 
ecological impact 

77. Make a timeline 

78. Look up a word in a thesaurus 

79. Create an outline 

80. Stud>^ for a test 

81. Give students step-by-step 
instructions or visual plans for 
projects 

82. Keep a journal 

83. See real-time data and graphs of 
position, velocity, and acceleration 
change over time 

84. Access writing prompts 

85. Learn to read and write Japanese 
characters 

86. Download notes for a research paper 

87. Practice multiplication tables 

88. Access the periodic table 

89. Use a glossary of technical terms 

90. Look at reference diagrams on parts 
of the human body 

91 . Play a collaborative problem-solving 
game to learn about genetics 

92. Listen to and study classical music 

93. Build a robot controlled by a 
handheld device 

94. Use a stopwatch to track times 

95. Read about the latest current events 

96. Access notes from a class lecture 

97. Create a map using GPS data 

98. Listen to and practice pronunciation 
with a voice recorder (English 
language learners) 

99. Have classes create their own mobile 
information channels to share 
information with other classes or the 
community 

100. Create a database on endangered 
species 

101. Read historical primary source 
documents 

I 

I 0K12 Handhelds Copyrighted by K1 2 Handhelds. 

j May fiot be reprinted without written permission 

from K1 2 Handhelds, info@k12handhelds.com. 




I 



@R*TEC 



31 






Picture This! 




.SEE^TEC 



ERJC 



An exciting and innovative unit is begin- 
ning in Mr. Maxwell’s class. The students 
are eager to find out what the topic for 
this week’s research project will be. While 
the students synchronize their handheld 
computers, the details of their assignment 
are provided along with rubrics for evalu- 
ating their final work. Mr. Maxwell 
gives them an overview of the 
topic and then helps them get 
started with their work. The stu- 
dents are pleased to have the 
outline and the rubrics avail- 
able whenever 
they need 
them. 

The claiss is 
divided into 
several 
teams. Team 
members brain- 
storm the topic and 
organize the informa- 
tion they already know 
gis well ais the information 
they want to know using a 
concept map on their 
handheld. A^en they are finished, they 
divide the work to be done, and pairs of 
students take responsibility for gathering 
different kinds of information on their 
handheld computers to bring back to the 
group. They use the calendar function of 
the handheld to set deadlines for gather- 
ing information, for creating a draft re- 
port, and for the final review by all team 
members. They set alarms to remind 
them of deadlines and create “to do’’ lists 
for the whole project and for each pair of 
students. 

Maria and Jermaine are responsible for 
finding appropriate images for the topic. 
They head to the media center and search 
for clip art and public domain images, 
download them to the computer, convert 
them to images for their handheld, and 
make notes, including the citations, about 
each image. 

Margaret and Bill create a vocabulary 
list by consulting with each team, doing 
some basic library research, and typing 
their notes into their handheld comput- 
ers; they use their handheld computer 
dictionary and thesaurus modules to 
create a glossary for the project. 



The job of interviewing several experts 
is assigned to four students — Carla, Beth, 
Matt, and Jeremy. They access the 
Internet’s yellow pages to find some ex- 
perts in the community and then make a 
list of questions they will ask each expert. 

Carla and Matt make 
appointments 
with a well- 
known expert. 
Dr. Stewart 
Thrift, from the 
phone attached to 
the Mr. Maxwell’s 
handheld. When 
Dr. Thrift arrives 
at the school, 
they 
record 
their 
inter- 
views 

using their 
handheld’s audio 
module and then take 
the recordings back to the 
classroom to edit for the rest of the 
group. Beth also snaps a few pictures of 
Dr. Thrift and some of the artifacts he 
brought with him using the digital cam- 
era attached to her handheld computer. 

Meanwhile, Beth and Jeremy find that 
one of the teachers in the school, Mr. 
Samuel Justice, is also an expert on the 
topic. They e-mail him from their hand- 
held computer, and he responds that 
he’d be willing to answer any questions, 
but it would be easiest for him to work 
by e-mail. The next morning, they find 
his answers waiting for them when they 
check their e-mail on their handheld 
computer. They export the e-mail to a 
word processor and edit the interview. 

Robbie and Barbara use their handhelds 
to search for specific information on the 
Internet right from their classroom. They 
summarize the information using the 
v/crd processing program on one of their 
handheld computers. 

Miguel and Sarah find that their school 
has several books on the topic, and the 
media specialist helps them download 
the electronic book version of one critical 
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work to their handhelds so that they can 
review it in the classroom. 

Sydney and Logan collect data from a 
variety of sources, including probeware 
they borrow from the science teacher. 
They enter the data into a spreadsheet 
program on their handhelds and then 
calculate and sort the data. They use 
this data to generate several charts and 
graphs for use in their final report. 

The team beams information to each 
other from time to time so that they all 
share the information that each person 
has found. Using one of the classroom 
computers and a presentation template, 
they each create a portion of the presen- 
tation and then combine the portions 
into one final product. They refer to the 
document on their handhelds that con- 
tains the rubrics Mr. Maxwell provided, 
checking each item to be sure they have 
included everything required. 

Now it’s time to show the presentation. 
They send the presentation over the 
school network to the presentation- 
station handheld and take turns explain- 
ing their findings to the rest of the class. 
Their classmates evaluate the presenta- 
tion and beam their results to Mr. Max- 
well, who adds his comments and then 
shares them with the team. To be sure 
each student has mastered the basics of 
the topic, Mr. Maxwell prepares a short 
quiz with true-false, multiple choice, short 
answer, and one challenging essay ques- 
tion on his computer. The students down- 
load the quiz, and when they take it, the 
handheld locks out access to any other 
information on the device until tiiey have 
beamed the answers to the teacher. 

All the students are excited about what 
they have learned and prepare a Web 
page to share their presentations with 
their parents and the community. Mr. 
Maxwell e-mails the parents with the URL 
and invites them to access the students’ 
work. Sydney’s mother gets the e-mail on 
her handheld computer on her way home 
from a business trip and, while waiting at 
the airport, takes a look at the class’s 
work. She is proud of her daughter and 
tells her so when she gets home. She e- 
mails the teacher as well. Mr. Maxwell 
receives the e-mail just as he finishes 
synchronizing his handheld computer 
with his desktop computer, transferring 
the grades and comments for each 
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student and recording their progress 
against the standards and benchmarks 
the district curriculum requires. 

Time to begin a new project? The stu- 
dents are ready to take on new roles 
and responsibilities. As long as they 
have their handheld computers, they 
know they can do the job. ♦ 



More Uses, Ideas, Software, and Case 
Studies for Handhelds in Education 



Center for Highly Interactive 
Computing in Education (Hi-Ce), 
University of Michigan — WWW.hl-ce.org 

Reports on the Center's development 
of a variety of free handheld 
applications for education 

K12 Handhelds— 
www.k12handhelds.com/casestudy 

Provides case studies on the use of 
handhelds in education 

Palm in Education — 
www.palm.com/education 

Includes case studies, programs, 
research, and resources 

PEP Ideabank — 
www.palmgrants.sri.com/ideabank.html 

Provides links and innovative ideas 
for using handhelds in education 
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Using Handheld Technologies 
in Schools 

The Beaufort County Schools (South CaroUna) and the Johnston County Schools (North 
Caroltna) have both undertaken pilot projects involving the use of handhelds in the class- 
room. In the following interview, Cyndi Pride, Beaufort County Schools’ Curriculum and 
Instruction Technology Specialist, and Diana Skinner, Johnston County Schools' Technol- 
ogy Director, share their experiences with their handheld technologies projects and offer 
some lessons learned. The experiences of these two districts provide insight and guid- 
ance for others interested in this use of technology. 

Beaufort County Schools Project Johnston County Schools Project 

♦ 270 students In grades 4-12 ♦ 5 schools, 60 students per site 

♦ Participants included: 

♦ All district principals (32) 

♦ All technology leaders (32) 

♦ 35 media coordinators 

♦ Superintendent’s Administrative 
Cabinet members (6) 




SEIR^TEC: Why did your school district initiate a project on using 
handheld technologies in the classroom? 



Diana: Both the Assistant Superintendent 
for Technology, E.D. 

Hall, and 1 had owned a 
Palm Pilot for a number 
of years and had become 
addicted to the tool. 

Upon reading articles 
from professional Jour- 
nals and visiting vendors 
at conferences, we pur- 
chased some devices and experimented 
with them for educational v^ue. 1 pre- 
pared a PowerPoint presentation to an- 
swer questions regarding use. cost, 
and educational value that 1 then 
showed to teachers and administra- 
tors. We applied to be a Palm Educa- 
tion Training Provider (PEH^P) trainer 
and attended training conducted by 
Palm in May 2001 in San Jose, Califor- 
nia. Endowed with a lot of 
resources and materials, 
probes, software, and train- 
ing materials, we began our 
initiative in summer 2001. 

E.D, Hall 





Cyndi: Our first handheld technologies 

a program involved teach- 
ers and grew out of the 
recognition that the 
handheld, long used in 
business applications, 
could provide a means 
for teachers to have one 
ready-at-hand tool to 
collect and manage digital data about 
teaching activities and student learn- 
ing. The handheld would provide the 
teachers \vlth a means to more easily 
collate student Information into a 
meaningful report, eliminating double 
entry and reiterative behaviors. Placing 
handhelds into the hands of students 
seems to be a logical next step. The 
handheld promotes equity in access at 
an affordable price, allowing us to 
bring more technology into the class- 
room. The size and portability allows 



for ease of movement from class to 
class and promotes use in the field. 
Although the size and weight of Uie 
handhelds would seem to increase the 
chance of technology “walking out the 
door,” this has not been an issue. 
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SEIR^TEC: Tell us about your project: goals, who is/ was participating, 
how long it has been/was in operation, and products you used. 

Diana: Our pilot this year has been investigative and administrative in nature. We have 
placed 30 Palms in the hands of fifth- graders, stxth-graders, eighth-graders, and 
eleventh-graders with a different curriculum focus for each grade. The PaJms have 
been used for language arts, math, science, computer skills, and \vriting assign- 
ments. We are also investigating their use as a communication device between 
home and school. All principals, media coordinators, technology leaders, and most 
Advanced Placement teachers have Palms, as do our central office administrators. 
This is a study to remove paper (for example, meeting agendas), to share informa- 
tion and technology tips, and to access data as a PDA. Administrators are accessing 
student information; parents and students are accessing homework and school cal- 
endars, and teachers are accessing observation notes. We began in September 2001 
with administrative training and in October with training of students and teachers. 
We are using a variety of Palm products — mlOO, ml05, m505, 1 1 Ic, and 5vx. Our 
software varies by curriculum, but we all use Docs To Go, PiCo Maps, Imageware, 
Notepad, Handy Sheets, and Cooties. 

Cyndi: The goal of our first project (Assessment... It’s in 
the Palm of Your Hand) was to provide teachers with 
a tool (Palm) to assist them in managing data from a 
variety of assessments to gain a better picture of 
student learning and thus to guide ins^uction. 

Nineteen teachers participated in the program, be- 
ginning in February 2001, with a review of litera- 
ture on the topic of assessment. Training was 
provided in the mechanics of using the Palm, in- 
cluding entering information, synchronizing the 
Palm, and transferring data from one application (for example, the Memo Pad) to 
another (for example, a Word document). Teachers used the basic Palm applica- 
tions, a spreadsheet application, and Teacher’s P.E.T., a grade book and learning 
management program. Additionally, each teacher reviewed and evaluated other 
software that might be applicable in a teaching environment. At the beginning of 
our project, there were only a few software applications specifically for educators, 
but now more are available, as developers have discovered this unique niche. Titles 
that were reviewed include Learner Profile to Go, Thought Manager, and Praesto 
Grade, to name a few. The teachers met weekly through the spring and continue to 
meet monthly, to share information, ideas, tips, and tricks. 





As a recipient of a Palm Education Pioneer (PEP) Research Hub Grant, Beaufort 
County School District was able to expand the program to include students in the 

fall of 2001. Two hundred 
seventy students in 
grades 4-12 use Palm 
Pilots to determine if the 
Palm helps students be 
more cognizant of their 
achievement because of 
the opportunity for self- 
assessment in project- 
based learning activities. 
We have three different 
models in the program: 
classes where students 
are issued Palms and use 
them at school and at 
home, class sets of Palms 
that are shared by several 
students for special 
projects, and daily 

(eontinoed next page) 
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in-class use of Palms by sissigned students. Teachers and students make extensive 
use of freeware, such as Hi-Ce’s PiCo Map and Cooties (www.handheld.hice-dev.org), Big 
Clock, and Diddlebug. As the program evolves, and new software applications are 
developed, we expect that schools will begin to budget for addition^ software. Some 
of our schools have augmented the Palms with peripherals including keyboards, 
digital cameras, and probeware. Several of our schools have purchcised additional 
Palms for both student groups and teachers. Teachers in primary school class- 
rooms are using the Palms, in part, to collect data for the South Carolina Readiness 
Assessment. Additionally, we have two schools that have purchased class sets of 
Pocket PCs, keyboards, and some wireless cards. 



SEIR^TEC: What was the reaction by 

students to the handheld technologies? 

Teachers? Administrators? 

Diana: They love them and want more devices! Those 
schools not involved in the pilot want to be in- 
cluded. We have even had a few parents purchase 
them for their students so the students did not 
have to share the school-provided Palm. Everyone wants us to develop more grant 
proposals to obtain more Palms! 

Cyndi: Most users have met the handhelds with enthusiasm: teachers, administrators, 
and students alike. All users appreciate the simplicity of the Palm interface and the 
avenues for communication and collaboration that result from being able to be 2 im 
data from one Palm to another. Teachers, especially, appreciate the ability to carry 
the Palm everywhere and to take or refer to notes anytime. Although some may 
think this insignificant, teachers have commented that women’s clothing does not 
always have pockets or belts, so some users carry alternatives, such as small 
shoulder bags and special lanyards. 

Administrators at several schools have also adopted handhelds. Administrators are 
using both Palm OS and Pocket PC platforms. Administrators are Interested in syn- 
chronizing student information data (SASIxp) onto their handhelds for anytime/ 
anywhere access to student schedules, teacher schedules, bus assignments, and 
discipline records. With few exceptions, our users find their Palms to be indispens- 
able. 1 have even been treated to more than one round of applause from students 
when introduced as the person who was responsible for the grant that got the stu- 
dents the Palms! 
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SEIR^TEC: Describe the training you conducted and tell us what 
training you think is essenti^ for anyone considering a handheld 
implementation for the classroom. 

Diana: Our training is systematic and thorough. Only two of us conduct initial training, 
but teachers and technology leaders work with teachers and students at each grade 
level. For phase one, it is extremely important that small groups are trained well 
and supported as they have questions and develop ideas. We are producing a train- 
ing manual and software recommendations as “must haves” to affect student learn- 
ing and achievement. We will share these at conferences and with other counties in 
North Carolina. You must have a cutting-edge team always ready to test the new 
software and devices. Lessons we learned were to set and maintain standards, to 
retain plenty of written documentation, to have clear objectives as to why to use the 
Palms, to do follow-up training, and to adjust training as necessary. 

Cyndi: Many of our users found Uiat organized training for the Palm was not necessary, 
but a few workshops were made available to less assured teachers, administrators, 
and even board members. To get users started, we offered an introduction to the 
Palm applications, buttons and screen views, preferences, creating and using catego- 
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Ties, tapping, typing, and beaming. The second 
workshop encompassed skills such as changing 
settings for buttons, using the shortcut stroke, and 
creating shortcut commands, phone lookup func- 
tions, and menu options. During training sessions, 
dialogue about classroom applications was encour- 
aged. and tips and tricks were shared among us- 
ers. Another training opportunity assisted users in 
loading the Palm desktop software and synching 
with Outlook and reviewed how to add programs to 
the Palm. Although we didn’t have formal training 

for specific software titles, the teachers met to share notes and assist each other 
with these new applications. Teachers using the Pocket PC handhelds were able to 
adjust to the CE versions of Word and Excel with little difficulty, once they under- 
stood the mechanics of tapping and typing. Teachers using this platform met for 
several hours to experiment with the tool and to brainstorm ways in which to use 
the handheld with students in the classroom. They received instruction in the 
class, along with the students, on how to connect to the network using wireless 
cards. Each school has a lead teacher who assists other users if problems or ques- 
tions arise. In some schools, the lead teacher received the handheld prior to other 
teachers and had the opportunity to practice with its use and to participate in 
training. The teachers became the primary instructors for their students. Some 
teachers offered additional training for parents so they could use the Palm to corre- 
spond with the teacher. In schools where the Palms go home with the students, 
teachers and parents have begun to communicate with each other in the Memo Pad 
application. Although training is not essential, it can help teachers maximize the 
utility of the handheld. Several of our teachers and administrators had used their 
Palms independently for a period of time, but many had not discovered special 
timesaving features, such as how to create shortcuts and use the shortcut stroke to 
make notations faster. Synchronizing the handheld and working with e-mail is 
problematic for some users. Additional training may also be required for wireless 
connectivity in future models. 




SEIR4TEC: What were the most successful 
uses of the handheld technologies by 
students? Teachers? Administrators? 

Diana: For students, the most successful uses were 
the calendar, PiCo maps, and probes. For teach- 
ers, it was the Handy Sheets website with digital 
worksheets for the Palm. Administrators really 
used the Doc To Go for teacher performance 
assessment. 
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Cyndi: One of the greatest benefits of the handheld is the ability to share information 
via infrared. Our teachers and students have capitalized on this feature. In a drama 
class, the teacher beamed scripts to the students in Memo Pad. Students also have 
journal questions beamed to them frequently, which they respond to, and either 
beam back their responses or sync their handhelds to the class computer. Beaming 
allows students to work collaboratively as well. In one class, students built sen- 
tences to review sentence structure and parts of speech. Students have also been 
able to work collaboratively to share research findings. In classes where we have 
used PCs connected to the Network, students were able to take notes from different 
sites on the Internet and then share those, by beaming, with other students. Stu- 
dents have also received a project “to do” list elaborating the steps of a project, 
which they can check off as each phase is completed. Teachers and students have 
worked together to define levels of accomplishment as a rubric for specific assign- 
ments. This can be beamed to students for reference as they complete the task. 
Students have used the Address Book feature to keep contact information for study 

(continued next page) 
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buddies, and the calendar feature is used to track assignments. The alarm feature of 
the calendar has been especially useful to remind students as long-term assignments 
come close to their due date. The calculator is helpful as it eliminates the need for 
another tool. Some math teachers have especially liked the fact that students can 
view, copy, and paste “recent calculations” into a memo, where they can describe 
their solution step-by-step. One high school teacher has used a demo version of 
MathWorks (www.imagiworks.com) that allows the Palm to function like a graphing calcula- 
tor. She plans to purchase this software for students next year. 



SEIR^TEC: What recommendations would you offer to schools and 
districts considering implementing handheld technologies? 

Diana: Even though we have only worked with the handhelds a short time, we highly 
recommend a four-step process: pilot, support, train, and support some more. We 
would also recommend gathering data and documenting and sharing the lessons 
learned with others. This is how we have built Justification for extending our project 
and obtained new ideas to try. 

Cyndi: The first decision schools or districts must make before implementing a program 
is what handheld platform to purchase and support. Currently, we have programs 
with each platform, and we will be reviewing the pros and cons for each as we move 
forward. Another consideration in purchasing a handheld is power. Generally, it is 
easier to recharge units than to constantly replace batteries. Schools will need to 
plan for how they will recharge a number of units; however, the cradle or charging 
cord is included in the purchase price. Although there is much to be gained in using 
the handheld straight out of the box, peripheral equipment and optional software 
greatly increase the utility of the technology. Therefore, planning for additional ex- 
penses is wise. From our experience, we feel it is important that the first teachers 
selected for the program have a basic comfort level with computer technology. 
Synching to the computer and moving documents from memo pads to Word and 
back might be intimidating to some teachers. 

Although formal training does not seem to have been a key indicator of success in 
using handhelds effectively in our projects, our teachers have commented that they 
benefited greatly from having the opportunity to talk with other users and share 
ideas. It has also proved helpful to have a designated point person in each building 
who is well versed in the workings of the handheld platform selected for the school. 
One other consideration is whether the handhelds will be used strictly in the class- 
room and during the school day, perhaps on field trips, or whether they will go 
home with students. ♦ 
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Using eBooks on Handhelds 



Electronic books, or eBooks, are electronic versions of books, 
magazines. Journals, reference manuals, textbooks, or any other 
document traditionally occurring as a printed volume. Electronic 
books can be viewed on a traditional computer screen and are 
also becoming increasingly popular on smaller, portable reader 
devices, including handheld devices. The appeal of these devices 
is that they can be carried around, much as a traditional book 
might, but can also contain numerous volumes and special fea- 
tures that are not available in the print versions of books. 

The features included in eBooks vary depending on the reader type 
and the document format. Many eBooks include features such as 
searching, built-in dictionaries, annotation tools, bookmarks, vari- 
able font size, hyperlinks, and auto-scrolling. 

Screen resolution is the biggest technical issue that is yet to be re- 
solved with eBooks. Until screen resolutions improve, reading 
eBooks puts more strain on one’s eyes than reading printed words 
on paper 

There are thousands of eBooks currently available on a wide vari- 
ety of topics. Some are free, and others sell for prices that are typi- 
c^ly somewhat, but not drastically, below average print book 
prices. It is expected that more educational materi^s, including 
textbooks, will be made available as eBooks. ♦ 



Book Document Formats 



Format 



Doc 



Description 



isilo 

LIT 

MemoPad 

MobiPocket 

PalmReader 

Text 

TomeRaider 



This is a common eBook format 
and works on a wide variety of 
platforms and with most viewers. 

(Note: This is not the same as the .doc 
files of Microsoft Word.) 

Offers higher compression and 
extended formatting capabilities 

Format for Microsoft eBook 
Reader; supports ClearType™ 
display technology 

Imports directly into Memo Pad; 
limited to 4K 

Offers extended formatting 
capabilities and support of 
multiple platforms 

Offers extended formatting 
capabilities 

Generic ASCII files 



Offers extended formatting 
capabilities and support of 
multiple platforms 



Compatibility 



Palm, PPG, 
EPOC 



Palm 

PPG 

Palm 



Palm, PPG, 
EPOC 



Palm, PPG 



Palm, PPG, 
EPOC 

Palm, PPC, 
EPOC 




O ■ 

ERIC 



eBook Reader Software 

♦ Adobe Acrobat Reader — 

www.adobe.com/products/acrobat 

♦ AportisDoc Reader — 
www.aportis.com 

♦ CspotRun — 

www.32768.com/bill/palmos/cspotrun 

♦ Express Reader Pro — 
www.qvadis.com 

♦ iSilo — www.isilo.com 

♦ Microsoft eBook Reader — 
www.microsoft.com/ebooks 

♦ MobiPocket Reader — 
www.mobipocket.com 

♦ PalmReader (formerly known as 
PeanutReader ) — 

www.peanutpress.com 

♦ TealDoc — www.tealpoint.com 

♦ TomeRaider — www.tomeraider.com 

Sources of Additional Information 
on eBooks 

General Information: 

♦ eBook Connections, Inc. — 

www.ebookeonnections.com 

♦ Electric eBook Publishing — 
www.electricebookpublishing.com 

♦ Open eBook Forum — 
www.openebook.org 

eBooks (content): 

♦ Adobe’s eBooks Central — 

www.edobe.com/epeper/ebooks 

♦ Amazon — www.emezon.com 

♦ Aportls — www.eportis.com 

♦ Barnes and Noble — www.bn.com 

♦ MemoWare — www.memowere.com 

♦ PalmReader — www.peenutpress.com 

♦ Project Gutenberg — 
www.gutenberg.net 

♦ Slate eBooks — 
http://slete.msn.com 

♦ Time Warner eBooks — 
www.twbookmerk.com/ebooks 

♦ TealPolnt Software — 
www.teelpoint.com/content.htm 

♦ Unlvers't'^ nf virtfinia’s 
Electronic Text Center— 
http://etext.iib.virginie.edu 

©K12 Handhelds Copyrighted by K12 
Handhelds. May not be reprinted without 
written permission from K12 Handhelds, 

info@k12handh6lds.eom. 
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Using Handheld Computers in Education: 
A Sampling of Projects 



Key Uses Users Reference 



♦ Gathering data 

♦ Beaming 

♦ Reference 

♦ Word processing 

♦ Scheduling 

♦ Organization 

♦ Organization 

♦ Data gathering 

♦ Beaming 



♦ Communication 

♦ Organization 



^ Databases 

♦ Spreadsheets 

♦ Presentations 

♦ eBooks 



♦ Schedules 

^ Student database 

♦ Data gathering 

♦ Probes 

♦ Beaming homework 

♦ Other possibilities 



♦ Probes 



♦ Organization 

♦ Graphing calculators 

♦ Note-taking 

♦ Reference tools 

♦ Internet access 

♦ Student database access 

♦ Coordinating professional 
schedules 

♦ Internet access 

♦ Reference tools 



^ cCoclw 

♦ Organizers 

♦ Probes 

♦ E-mail assignments 

♦ Downloadable worksheets 



♦ High school students and 
teachers 



♦ High school students and 
teachers 



♦ All teachers and 
administrators 



♦ High school students 



♦ High school administrators, 
students, and bus drivers 



♦ Middle and high school 
students 



^ High school special 
education students 



♦ Administrators 



^ Middle and high school 
studei its 



♦ High school teachers and 
students 



Consolidated High School Distnet 230 makes use of handhelds. An 
overview of a large handheld piiot involving nearly 1,700 students 
and 65 teachers. wufW.d230.org/Handheld 



Handhelds go to class — New short film and story. A large school 
district equipped students and teachers with 2,200 handheld 
computers in the fall of 2000. According to English, biology, and 
social studies teachers in the district, use of the handhelds has 
increased student productivity and efficiency across all disciplines. 
http://glef.org/orlandpk.html 

Leeuwenburg, Todd. (January 1999). Dick Tracy goes digital. 
Electronic School. An early, but still applicable, discussion of the 
professional uses of handhelds for educators. 

www.ele6tronjc-school.com/199901/0199toolsofthetrade.htm 

High school students learn workplace skills with Palm handhelds. 

A team of students in a school-to-work program use handhelds as 
an efficient way to manage jobs, equipment, and personnel and to 
share information and communicate easily. 
www.palm.6om/edit cation/$tudle$/$tudy14.html 

Stover, Del. (March 2001), Hands-on learning. Electronic School, 
One company wants to use bar-code scanners to allow bus drivers 
to record the pickup and delivery of students by scanning their ID 
cards. Principals use the handhelds as a tool that allows them to 
check their schedule on the fly, determine if a student in the 
hallway is supposed to be in class, or jot down a note for later 
reference, WWW.electroni6-$6hool.60m/2001/03/0301 f4.html 

Handhelds and probes become keystone of learning environment. 
This describes a mobile learning environment that makes it easy to 
collect and analyze scientific data and to collaborate between 
classes and schools. www.palm.60m/edu6ation/studla$/$tudy15.html 

Independence. Describes a project to help special education 
students excel through the use of handheld technology, 
www.palm.60m/edu6atioa/sttidies/$tudy3.litml 



Pushing barriers. Providing administrators with instant student 
information and productivity tools, 

www.palm.60m/adu6ation/studles/study4.html 

E-WIRE. (January 2001), Electronic School, Highlights several 
applications of handheld computer usage in a variety of classroom 
settings, www.ala6troni6-$6hool.60m/2001/01/0101awira.html 

Thomas, Karen, (May 28, 2001). Inexpensive handheld PCs find 
way into classrooms, uetroii News Online, u iSCuooCs L* high 
school where all 450 ninth-graders and 30 teachers were issued 
handheld computers, 

hJJ.p://d!*-sy:.;off/?.001/<»>«l«MWs/0105/28/a11-228994.litiii 
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Key Uses 



Users 



Reference 



♦ Searchable reference ♦ University medical students 

tools 

♦ Internet access 

♦ Schedules 

♦ Assessment 

4 Electronic flashcards 

4 Internet access ^ High school students 

♦ Concept mapping 



♦ eBooks 



♦ All students 



♦ eBooks 



♦ High school students 



♦ Assessment ♦ Physical education teachers 

♦ Grading 

4 Class management 



♦ Digital imaging & ♦ Elementary students 

captioning 

♦ Beaming 



4 Barcode scanners ^ Media specialists 

♦ Radio Frequency 
Identification (RRD) tags 

♦ Beaming 

♦ Web access 

♦ Reference 

♦ Circulation systems 

♦ eBooks 

♦ Policies 



Stanford University School of Medicine Palm Project — 

This project was created to improve the experience of Stanford 
medical students by making available educational tools that are 
mobile, comprehensive, and interactive. htt^://Palm.Stanford.e(ly 



ironer, Andrew. (September 26, 2001). Handheld computing: new 
best tech tool or just a fad? Education Week. Descriptions of a 
variety of pilot projects using handhelds in different subject areas, 
along with some of the educators' concerns. 

WWW .edw6ek.com/ew/8W_prjiitstory.cfm?sl8g = 04palm.h21 

Flanigan, Robin L. (March 2001). Tools of the trade. Electronic 
School. Discussion of eBooks with examples from a number of 
different school pilot studies. 

www.electroniC'SchooLcom/2001/OB/OB01tool$ofthetrad6.html 

Pickett, Debra. (June 26, 2001). Will handheld devices replace 
textbooks? Chicago Sun-Times. Highlights the use of the goReader 
in a junior class on American literature. 
www.$ttnfim8$.com/outpyt/f6ch/coRf26.html 

Dorman, Steve M. (May 1998). Enhancing school physical 
education with technology. The Journal of School Health, 68(5), 




219-220. The use of handheld devices that assist with fitness 



testing, grading, and class management is increasing. These 
devices help the physical educator collect and input information in 
the classroom or in an outdoor setting. 



Vandenabeele, Janet. (July 23, 2001). Science class gets boost: 
Handheld computers enhance school’s enrichment lessons. Detroit 
News Online. Describes a summer program that utilizes handhelds 
packed with educational software. 
http://defn6WS.com/2001/scho8ls/0107/2B/cOB-252214.htm 



Embrey, Theresa Ross. (March 2002). Today's PDAs can put OPAC 
in the Palm of your hand. This article contains a wealth of current 
and possible future uses of handheld devices in the media center. 
WWW.infotoday.com/cilma 3 /marO 2 /ambrey.htm 



♦ Scheduling ♦ High school teachers and 

4 Web access administrators 

♦ Reference 

4 Organization 



McCampbell, Bill. (March 2001). Taking a look at pocket digital 
assistants. Principal Leadership, 1{7), 12-1 A. Course schedules 
and assignments put on a class Web page and updated to PDAs 
using the sync capability. Supplemental reading material can be 
posted to students’ devices. Calculators, conversion charts, 
checklists, and other class paraphernalia replaced with handhelds. 



♦ Organization ♦ All teachers 

♦ Word processing 
4 Scheduling 

♦ Beaming 

♦ Presentations 
^ P.'”ofO-s!on?* 

♦ Assessment 

4 Data gathering 
4 Classroom management 

♦ Internet access 

♦ E-mail 



McFadden, A., Price, B.J., & Marsh, G. (September, 2001) A 
valuable technology tool for student teachers. Three University of 
Alabama educational-technology experts describe how handheld 
computers can enhance productivity, classroom information 
management, and instructional support. While it targets student 
teachers, many of these scenarios apply to any educator. 
www.3iet.or3/pdatooi.i)Tmi 





Grant Opportunities 








er|c 






irc 



Any grant opportunity for educational 
technology is one that can be tapped for 
handheld computers. Just remember to 
address the specific grant requirements 
by including handheld applications and 
programs that address specific instruc- 
tional goals. For example, if you are 
writing a grant for materials to support 
science instruction, you might include 
handhelds, science data probes, cur- 
riculum materials, graphing calculator 
software, and digital cameras. In addi- 
tion, make sure to emphasize the way 
that handhelds can address equity and 
access issues because of their low 
cost and mobility. 

Some grants, like 
Texas’ Technol- 
ogy Integration 
in Education 
(TIE) grants, 
even spe- 
cifically 
allow hand- 
helds as an 
eligible use. 

Progressive 
states are 
starting to 
make handhelds 
a part of their over- 
all technology plans 
and funding schools to 
purchase these devices. 

In addition, many schools 
are using professional devel- 
opment grants to purchase handheld 
workshops (some of these include hand- 
held devices in the cost). This is a cre- 
ative way to fund professional 
development and the handhelds them- 
selves all in one. 

Here are a few grants that are specifically 
geared toward handhelds: 

Palm Education Pioneer Grant Program— This 
program gives Palm handhelds to K-12 
teachers and their students so they can 
use them in new ways for teaching and 
learning. This program is administered by 
SRI International’s Center for Technology 
in Learning. It is limited to hardware 




grants. While the program does not have 
a next round of grants scheduled at the 
time of this writing, check their website 
at www.palmgrants.sri.com. This website also 
has many great ideas about how to use 
handhelds in education. 

Handspring Foundation Grants— This 
foundation offers both cash and product 
grants to qualifying organizations. The 
cash grants are made to nonprofit 
organizations that focus on issues 
relating to children and youth who are at 
risk. These grants range from $1,000 to 
$25,000. The product grants provide 
hardware to qualified 
nonprofit organizations 
and are geared toward 
demonstrations of an 
Innovative use of 
handhelds that will 
V creatively address 
critical community 
concerns. More 
Information is 
\ available at 
www.handspringxom/ 
company/ 

I foundation. 

/ Center for Innova- 
/ tive Learning Tech- 
nologies— This 
organization offers 
a limited number of 
seed grants each year to ini- 
tiate cross-institutional collabora- 
tions in the area of learning technologies. 
The themes of the program are Visualiza- 
tion aind Modeling, Ubiquitous Comput- 
ing, Community Tools, and Technology 
in Learning Assessments. The range of 
award is $6,000 to $15,000. More infor- 
mation can be found at www.cilt.org/ 
seedgrant/projects.html. 

Tl-Navigator Collaboration Grants— This pro- 
gram awards grants that allow for the 
purchase of the Tl-Navlgator system at 
a reduced price of $5,500 versus the list 
price of $9,800. For more information, 
call the Tl-Navigator Collaboration 
Grants office at 866 846-2844 or 
e-mail them at ti-navigator(@ti.com. 






k 



There are some other organizations 
that offer grants in the general area of 
educational technology and have funded 
handheld projects in the paist. One such 
organization is Intel. Check out its 
website at wwwJntel.com/education/grants. 

Also, make sure to check with your state 
educational technology office to see what 
educational technology and professional 
development grants they have available. 

As with any grant application, the follow- 
ing tips are useful to remember when you 
are writing grants for handheld programs: 

♦ Read the grant request for proposal 
carefully and tailor your proposal to 
those requirements. 

♦ Focus on student achievement and the 
improvements your proposed program 
will make; make sure to indicate 
specific and meaisurable objectives. 



♦ Design a program that can be 
replicated by other schools and 
include how you will share information 
about your experience with others. 

♦ Make sure to include information on 
how your program will be evaluated. 

♦ Make the budget detailed, reasonable, 
and representative of the rest of your 
proposal. 

♦ Make sure you meet all the technical 
requirements of the proposal. 

♦ If your program doesn’t get funded by 
this grant, try again. Many wonderful 
programs aren’t funded the first time 
around. ♦ 



©K12 Handhelds Copyrighted hy K1 2 
Handhelds. May not be reprinted without written 
permission from K12 Handhelds, 

info@kl2handhelds.coni. 



Professional Development and Handheld Technologies 



Connected University's Pocket CU — A prototype of an online class utilizing a handheld 
device as the delivery medium. The content for this class Is ‘Teaching to 
Standards." htt|)://cu.classroom.com/|)alm 

Kl2 Handhelds — A variety of both on-slte workshops and online courses that start 
with an Introduction to handhelds for beginners and then build to more 
advanced courses that focus on applications for administrators, teachers, 
and students. www.k12handhelds.com/dev.|>h|> 

Palm PETC Program — ^The Palm Education Training Coordinator (PETC) program is a 
traln-the-tralner program designed to support K-12 In-service and pre- 
service professional development programs focused on the educational 
uses of Palm handheld computers. www.|>alm.com/education/training 

Palm PETP Program — RegionaJ workshops conducted by PaJm Education Training 
Providers (PETP). PETPs are Palm Certified Trainers with expertise in the 
Palm OS and years of personal experience as K-12 educators and adminis- 
trators. www.palm.com /education/programs/regional 

Note: A few universities, colleges, and private training centers are now ojfering diS’ 
tance education courses that are designed around handheld delivery methods. For 
example, Brigham Young University offers a high school cowse for U.S. History that 
is taken with Palm OS devices in addition to the traditional computer connected to 
the Internet 
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Communication and Collaboration Applications (continued) 
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Hardware Manufacturers 

Palm OS 

♦ Palm 

www.palm.com 

4 Handspring 

www.handspring.com 

♦ Sony Clie 

www.sonystyle.com/vaio/clie/ 

index.shtml 

4 Sjnnbol 

www.symbol.com/products/ 

mobile_computers/ 

mobile_computers.html 



iVindows CE/Pocket PC 

♦ Compaq — iPAQ Pocket PCs 

www.compaq.com/products/ 

handhelds/pocketpc/index.html 

4 Casio 

www.casio.com/personalpcs/ 

section.cfm?section=l9 

4 Hewlett Packard 

Jornada www.hp.com/Jornada 

4 Symbol 

www.symbol.com/products/ 

mobile_computers/ 

mobile_computers.html 




Software Resources 

♦ C|NET Downloads — Shareware, 
freeware, and demo software for 
Palm and Windows CE/Pocket PC 
http:ffdownloa(lcnetcomldlownloadls/ 
0-1726360, html?tag=stbc.gp 

♦ EuroCool — Shareware, freeware, 
and demo software for Palm 
www,eurocooLcom 

♦ Handango — Shareware, freeware, 
demos, and commercial software for 
Palm and Windows CE/Pocket PC 
www.handango.com 

♦ Hi'Ce Learning in the Palm of 
Your Hand — Free educational 
software for Palm 
www.handheld.hice-dev.org/ 
downloacthtm 

♦ Palm Boulevard — Shareware, 
freeware, and demo software 
for Palm 

http://palmblvd.com 

♦ Palm Education — Educational 
software downloads and reviews 
for Palm 

www.palm.com/education 

♦ Palmgear — Shareware, freeware, 
demos, and commercial software 
for Palm 

www.palmgear.com 

♦ PalmSpot — Freeware, shareware, 
and commercial applications for 
Palm. Also sells hardware add-ons 
www.palmspot. co m 

♦ Peanutpress — Electronic books for 
Palm and Windows CE/Pocket PC 
www.peanutpress.com 

♦ Tucows — Shareware, freeware, and 
demo software for Palm and 
Windows CE/Pocket PC 
www.tucows.com 
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Educational Hardware/ 
Software Resellers 

The following companies accept 
educational purchase orders and 
offer academic pricing: 

4 Educational Resources 

www.educationalresources.com 

4 K12 Handhelds 

www,kl2handhelds,com 

4 MicroWarehouse 

WWW, microwarehouse.com 

♦ Software Express 
www.swexpress.com 



Journals/Newsletters 

♦ Curriculum Administrators: 
Education in Hand — A supplement 
to Curriculum Administrator, case 
studies in handheld educational 
uses www.ca-magazine.com/ 
SpecialReports/eih.asp 

♦ Handheld Computing — Printed 
monthly magazine for Palm devices 
www.hhcmag.com 

♦ InSync Online — Palm, Inc.’s 
monthly electronic newsletter 
www.insync -palm, com 

♦ Mobile Computing — Printed 
monthly magazine covering portable 
computers and handheld devices 
www.mobilecomputing.com 

♦ Palm Power Magazine — ^An 

online magazine for Palm 
www.palmpower.com 

♦ Pocket PC — Printed monthly 
magazine for Pocket PC devices 
www.pocketpcmag.com 
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News, Reviews, 
and Support 

♦ NearlyMobile — Information 
dedicated to the new Palm user 
who is not technology savvy 
www.nearlymubile.com 

♦ Palm Infocenter.com — ^The latest 
Palm OS industry news 
www.palminfocenter.com 

♦ Palm Knowledge Finder — 

Online database of Palm tips 
and tricks, help, etc. 
www.palm.com/support/kb/ 
link_toJcb.html 

♦ Palmtops/PDAs — News, reviews, 
FAQs, and software links 
http://palmtops.about.com 

♦ PDA Constituent Group — 

Discussion of issues and 
challenges concerning use of PDAs 
in higher education 
WWW. educause. edu/memdir/cg/ 
pdcuhtml 

♦ PDA Geek — News, reviews, tips, 
and tricks 

w ww.geek. co m/pdageek/ 
pdamain.htm 

♦ PDABuzz — News, reviews, forums, 
and other resources 
www.PDABuzz.com 

♦ PDAStreet— The PDA Network of 
free downloads, reviews, news, 
and message boards for all the 
major handhelds 
http://pdastreet. com 

♦ pdaED.com — News and reviews 
about handhelds in general. 
Bulletin boards specifically devoted 
to handhelds in education 
www.pdaed. co m 

♦ Slashdot — PDA news for nerds 
http://slashdot.org/ 
search.pl?topic=100 

♦ ZDNet Shopper — Cuiiipcuicsuii 
pricing for handhelds 
http://zdnetshopper.cnet.com/ 
shopping/0-11013-14Ui-0- 
0.html?tag=dir 
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of Terms Used 

with Handheld Technologies 



802.11b— See Wi-Fi 

Archive Files — copies of deleted or purged handheld data that exist on the 

desktop computer and can be used to restore some deleted or purged 
data. 

Beam — describes the use of infrared to transfer data from one handheld to 
another. With appropriate software, beaming can also be used to send 
a document from the handheld to an infrared-capable printer. 

Bluetooth^^ — a wireless technology with a range of approximately 30-meter 
radius; works well for hard cable replacement. 

Cradle — the stand that a handheld computer sits in to sync to a desktop 
computer. Used with some models as a battery chairger. 

eBook — an electronically formatted book, designed to be read from a 

computer, which may be a desktop computer, a handheld computer, or 
a specialized electronic book reading device. 

Expansion Modules — items that are added on to a handheld device; these can be 
memory cards with software, such as large dictionairies or eBooks, or 
hardware items, such as digital cameras, GPSs, MP3 players, or 
science data probes. 

CPS or Global Positioning System — a device that uses a network of satellites to 
determine precise positioning data; GPSs cire used for navigation, 
mapping, surveying, and other applications where precise positioning 
information is needed. 

Graffiti® — handwriting recognition software program that is the primaiy 
means of data input for the Palm OS. 

Handheld Computer or Handheld — small computerized devices that fit into the palm 
of the hand and are designed for mobile computing. 

MMC or Multimedia Card — a type of expansion card supported by the latest Palm 
handheld devices; these cards are very small, about the size of a 
postage stamp; see also “Secure Digital.” 

MP3 — a format to facilitate the storage, management, promotion, and 
delivery of digital music. 

OS or Operating System — software that is designed to manage hardware devices 
in order to enable applications and users to access it easily; examples 
of operating systems used for handheld computers Include Windows 
CE® and the Palm OS®. 

Palm Desktop® — software that runs on a desktop computer and can be used to 
enter, edit, or view data from a Palm OS handheld; data is updated 
and exchanged between the desktop and the handheld through the 
HotSync process. 

Paim OS® — the operating system developed by Palm, Inc. for liandlieid 

devices; handheld devices produced by Palm, Handspring, IBM, Sony, 
and others use this operating system. 

PAN — Personal Area Network. 
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PDA or Personal Digital Assistant — a specific type of handheld device that serves the 
purpose of organizing personal information; these may include 
calendars, address books, notepads, calculators, and other useful tools. 

PDB — a common Palm OS file extension that represents data or a databaise. 

PIM or Personal Information Manager — a specific type of handheld device that serves 
the purpose of organizing personal information; these may include 
calendars, address books, notepads, calculators, and other useful 
tools. 

Pocket PC — a generic term for a handheld computer running the Windows CE 
operating system; see ‘Windows CE“ for more information. 

PRC — a common Palm OS file extension that represents an application. 

SD or Secure Digital — a type of expansion card supported by the latest Palm 

handheld devices; these cards use Flash technology and are writeable. 

Springboard® Module — an expansion module that extends the functionality of a 
Handspring Visor handheld device; examples of Springboard modules 
include digital cameras, GPSs, and MP3 players. 

Sync — short for synchronize. 

Synchronization — ^The process by which the desktop computer and the handheld 
exchange and update information. 

Ubiquitous Computing — computing that is omnipresent and is, or appears to be, 
everywhere all the time; may involve many different computing devices 
that are embedded in various devices or appliances and operate in the 
background. 

USB or Uni\/arsal Serial Bus — a type of connection to a desktop computer, 

which can be used to HotSync data; generally much faster than a 
standard serial connection. 

Web Clipping — used to describe the editing or “clipping” of parts of Web pages 
to make them more readable on a handheld device. Companies such 
£is AvantGo provide this service. 

Wi-Fi (also known as 802. 1 lb) — a wireless technology with a range of 
approximately 150-300 meters in radius and supports up to 11 
megabit data rates, which makes it appropriate for wireless Internet 
access; this is the technology used by Apple AlrPorts and Xircom‘s 
Wireless Ethernet modules. 

Windows CE® OS — the operating system developed by the Microsoft 

Corporation for embedded systems and handheld devices; handheld 
devices produced by Compaq, Hewlett Packard, and others use this 
operating system. 

Wireless — generally used to describe a device having Intranet or Internet 
connectivity without wires; this can be achieved through wireless 
modem technology similar to a cellular phone or through wireless 
Ethernet cards using 802. 1 lb technology. 
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When members of Congress 
passed the No Child Left Behind 
legislation, they called for sweep- 
ing changes in the way federal 
dollars are distributed for technol- 
ogy in schools. Gone are the Tech- 
nology Literacy Challenge Fund 
(TLCF) and Technology Innova- 
tion Challenge Grants (TICG), 
which were consolidated into the 
Enhancing Education Through 
[ Technology (EETT) program. This 
new program, which is currently 
budgeted at $700 million a year, 
requires states to: 

♦ Award half of the amount 
available to local education 
agencies (LEAs) through a 
formula based on Title I 
shares and half through a 
competitive process. 

♦ Make competitive awards to 
high-need LEAs or partner- 
ships that include a high-need 
LEA and at least one entity 
that can assist the high-need 
LEA to integrate technology 
effectively into classroom 
instruction. 

♦ Use at least 25% of its formula 
allocation for high-quality pro 
fessional development activities 
to prepare teachers to integrate 
technology into instruction. 

♦ Require local applicants to 
describe how they would 



identify and promote strat- 
egies, based on relevant 
research, that integrate 
technology effectively into 
curricula and instruction. 

♦ Develop accountability 
measures and a process 
for evaluating the extent to 
which the activities carried 
out with program funds are 
effective in supporting the 
integration of technology 
into curricula and instruc- 
tion. (www.ed.gov/offices/OESE/ 
esee/progsum/title2b.html) 

Until now, states and districts 
have seldom been required to 
show the link between spend- 
ing on technology initiatives and 
student achievement. The new 
legislation calls for educators not 
only to use research-based prac- 
tices but also to provide evidence 
that teachers and students are 
actually using technology to 
improve student achievement. 

For example, state plans are 
expected to include program 
goals, performance indicators, 
performance objectives, and data 
sources for assessing the effec- 
tiveness of programs in terms 
of the teachers* and students’ 
use of educational technology 
in support of academic achieve- 
ment. In turn, states are requir- 
ing recipients of EETT funds to 



(continued on page 2) 
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(continued from page 1) 

show that money spent on technology 
ultimately leads to improved student 
learning. As Barbara Teusink, Direc- 
tor of Technology for the South Caro- 
lina State Department of Education, 
explains: 

The Ed Tech Grant program re- 
quires extensive accountability 
and evaluation procedures for use 
of technology funds. The No Child 
Left Behind Act is very timely 
for South Carolina as we begin 
to devise our 2003-2008 State 
Technology Plan. In correlation 
with Ed Tech guidelines, our plan 
will be performance-based and 
include measurable goals, objec- 
tives, indicators, and benchmarks 
for achievement at specific points 
throughout implementation. The 



evaluation component will add 
credibility to our technology pro- 
grams and allow the State Depart- 
ment of Education to demonstrate 
the positive impact of professional 
development and technology inte- 
gration in the core curriculum areas 
on student achievement. 

Because educators across the nation 
are, or soon will be, scrambling to 
find resources that will help them 
evaluate the effectiveness of their 
programs and the links to student 
achievement, this issue of NewsWire 
features articles about state and local 
accountability efforts, some things 
to think about when developing an 
evaluation plan, and resources for 
conducting useful evaluations. ♦ 



Tips for iVritinq an Evaluation 
Plan for a Tecnnolo^y Grant 



by Elizabeth Byrom, Ed.D., SEIR^TEC 
Principal Investigator 

Ask anyone who has reviewed propos- 
als for federal or state grants about the 
most important factor that determines 
which ones are funded and which ones 
are not, and they will invariably say 
the evaluation section. As Zucchini 
Dean of the Mississippi Department 
of Education says, “Most proposals 
contain very little about evaluation . . . 
what they do say usually doesn’t cor- 
relate with the goals they indicated 
in the proposal, and the focus is usu- 
ally not on student achievement and 
teacher competency.” There are dozens 
of reasons for these shortcomings, but 
one is that many of the educators who 
write the grant proposals have little or 
no experience in developing evaluation 
plans. With that in mind, SE1R4TEC 
offers the following tips for writing an 
evaluation plan that will win approval: 

1 . Start with your project goals and 
objectives and work your way 



backwards to determine your 
evaluation questions, strategies, and 
methods. For example, if your goal 
is to improve student achievement, 
you need to define what you mean 
by “student achievement,” and then 
identify the conditions that have 
to be in place in order for improve- 
ment to occur. Some essential con- 
ditions are as follows: 

♦ Curriculum, assessment, and 
technology use should be 
aligned. 

♦ Teachers and students have to 
use technology in meaningful 
ways. 

♦ Teachers must have ongoing, 
high-quality professional devel- 
opment that is directly related 
to what students are supposed 
to learn. 

2. Ask good evaluation questions. 
Good questions will lead to the 
answers you need in order to deter- 
mine whether your project makes a 
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difference in teaching and learning. 
Evaluation questions might ask: 

♦ To what extent are teachers us- 
ing what they learned in profes- 
sional development activities? 

♦ Do teachers and students have 
ready access to modern comput- 
ers and the Internet? 

♦ How effective is tfie project 
in identifying and addressing 
barriers to technology integra- 
tion? (See article on Evaluation 
Questions — Guiding Inquiry in 
Schools on page 4 for additional 
information.) 

3. Collect baseline data at the begin- 
ning of the project and ask the same 
questions over time. For example, if 
your project focuses on professional 
development, begin by determining 
teachers’ current level of technol- 
ogy proficiency, use of technology, 
attitudes, interests, and needs. If 
you periodically ask them the same 
kinds of questions, and if their pro- 
ficiency and use improve, you have 
some evidence of the cumulative 
effectiveness of the program. 

4. Counting boxes isn’t enough. It can 
be useful to know the number of 
computers available for student use 
or the student-to-computer ratio, 
but if you want to know whether 
technology is making a difference 
in teaching and learning, you have 
to examine how well and how much 
students and teachers are using it. 

5. Look beyond standardized student 
achievement data. Standardized 
tests seldom measure the areas 

of learning where technology has 
been shown to have an impact, 
such as research skills, communica- 
tion skills, quality of student work, 
dropout rate, and discipline 
referrals. 

6. Surveys are no 
longer adequate 
as the single 
measure for 
determining 
the quality 
and impact of a 
technology project, 
mainly because 







self-reporting data are often 
unreliable. Consider using a variety 
of qualitative and quantitative 
measures, such as classroom 
observations, school portfolios, 
interviews, and focus groups. (See 
Thinking Beyond Surveys on page 2 1 
for advantages and disadvantages of 
various measures.) 

7. You don’t have to develop evaluation 
tools; some excellent ones already 
exist. The U.S. Department of Edu- 
cation’s book An Educator*s Guide 
to Evaluating the Use of Technology 
in Schools and Classrooms is a good 
place to start. (Available through 
the Database of the U.S. Depart- 
ment of Education Publications in 
ERIC or available at v/ww.ed.gotf/pubs/ 
pubdb.html.) Also look at the websites 
of the Regional Technology in Edu- 
cation Consortia (RTEC), such as 
the High Plains RTEC’s Profiler, the 
South Central RTEC’s database of 
evaluation instruments, the North 
Central RTEC’s enGauge, and 
SEIR^TEC’s technology integra- 
tion progress gauge. (See Tools for 
Evaluating Technology Projects and 
Programs on page 26.) 

8. Above all else, read the directions 
in the grant application package. If 
you don’t meet all the funding agen- 
cy’s requirements for evaluation, 
the agency will be hard pressed to 
fund your project. This is especially 
true for the technology grants fund- 
ed through the No Child Left Behind 
legislation because the states must 
provide data from the districts in 
order to show that the money is 
being well spent. 

If you follow these tips and still feel 
uncertain about the quality of your 
evaluation plan, remember that it’s okay 
to ask for help. Although there isn’t an 
abundance of evaluators with 
experience in educational 
technology, you should 
be able to find an 
evaluator or research- 
er at a nearby college 
or university who can 
review your plan and 
offer suggestions. ♦ 
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Evaluation Questions — 
Guiding Inquiry In Schools 



by Ann Abeille, Director of Research 
and Evaluation, Learning 
Innovations at WestEd 

Through the No Child Left Behind legis- 
lation, school and district practitioners 
are being asked to become more 
involved in the evaluation of the effec- 
tiveness of their schools’ efforts and 
progress. Many practitioners are short 
on time, funding, and evaluation expe- 
rience. However, educators can maxi- 
mize their learning from this work by 
building their evaluation around clear- 
ly articulated evaluation questions. 

The critical guidance for evaluation 
work. Just as in school-based action 
research, is identification, use, and 
reflection on essential questions. These 
questions drive the learning, and evalu- 
ation is about learning: 

♦ Learning how students and teach- 
ers are using technology 

♦ Learning what kinds of professional 
development and support are 
making a difference in classroom 
practice 

♦ Learning how the infusion of 
technology is changing student 
approaches to learning, character- 
istics of student products, and stu- 
dent achievement in curricular 
areas 

As practitioners engage in evalu- 
ation work, whether involved in 
a formal evaluation (perhaps 
supporting the work of outside 
ev^uators) or undertaking 
an informal examination of a 
school initiative, they need to 
consider the following aspects 
of evaluation questions. 

Question Identification 

Identify the overarching 
questions that you want 
to answer and why. First 



of all, what do you and the people in 
your school want to learn from this 
evaluation work? If you are working 
with grant funds, what do the funders 
want to learn? For example, if your 
school or district has received a grant 
to engage faculty, students, and com- 
munity members to use a variety of 
technologies to enhance science and 
mathematics learning through a com- 
munity-based environmental study, 
what would you want to learn from 
your evaluation efforts? Some of your 
evaluation questions might be: 

♦ How has the funding from the grant 
actually been used? What training 
was provided to students and fac- 
ulty in using the various technolo- 
gies? What was the perceived quality 
of the training? How many students, 
faculty, and community members 
were involved in the training? 

♦ How did students and faculty use 
technologies in the environmental 
study? What areas of mathematics 
did students explore? To what extent 
did students engage in mathematics 
and science inquiry? What role did 
technology play in this inquiry? 

♦ What mathematical concepts or 
skills did students gain through 
this project? To what extent did 






students demonstrate mathematics 
and science inquiry skills? 

♦ As this program is instituted 
and continued » are there notable 
increases in the percentage of stu- 
dents meeting gradedevel-appropri- 
ate technology standards? Is there 
improvement in student achieve- 
ment in the areas of mathematics 
focused upon in the project? 

♦ How have student, faculty, and com- 
munity attitudes changed through 
this project (e.g., attitudes toward 
mathematics and science, the use of 
technology, or the environment)? 

Identifying and prioritizing these ques- 
tions is the first step toward meaningful 
evaluation and essential learning for 
your school. 

Matching Methods to Questions 

It is essential to remember that the iden- 
tification of evaluation questions dictates 
the choice of evaluation metliods. Practi- 
tioners need to ensure that the data-gath- 
ering methods used will result in answers 
to the identified questions. 







Using methods such as question- 
naires, interviews, and focus groups 
makes perfect sense when you wish to 
determine changes in attitudes (e.g., 
attitudes toward technology use). How- 
ever, classroom observations become 
the essential method (with interviews 
or questionnaires providing additional 
information) to gain useful data about 
the use of technologies or the engage- 
ment of students in mathematics and 
science inquiry. 

Although teacher interviews may give 
some insights into student learning 
and changes in student achievement 
of technology standards, an analysis 
of student products will more directly 
answer such an evaluation question. If 
the development of certain mathematics 
learning has been targeted within this 
project, an appropriate method may 
be the tracking of changes over time in 
teacher-designed assessments or select- 
ed sections of standardized tests. 

It is essential to choose methods for 
your evaluation that will yield appropri- 
ate data for answering your top-priority 
questions. 

Reflections on Evaluation Questions 

Finally, it is critical, when the data are 
in and analyzed, to return to the evalu- 
ation questions and the results in order 
to determine the implications for your 
future work. For instance, perhaps you 
found that although the quality and 
reach of the technology-related profes- 
sional development was excellent, too 
much time elapsed between that learn- 
ing and the actual use of the technol- 
ogy in the environmental study, so 
time and energy had to be wasted on 
additional training. Or perhaps your 
classroom observations indicated that 
although use of graphing calculators 
was to be an essential component of 
the environmental project, the use was 
negligible. What if after three years 
of similar project work, the targeted 
areas for improvement in mathematics 
achievement showed no improvement? 
These findings would certainly lead you 
to strategic changes in your work. ♦ 
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Lessons Learned from Action 
Research: Evaluation from the Trenches 





by Zelia Frick, Supervisor of Instruc- 
tional Technology, Guilford County 
Schools (North Carolina) 

‘Tour grant has been funded!” These 
words are music to the ears of appli- 
cants who work diligently to acquire 
much-needed funding for technology. 
Recipients eagerly await the arrival of 
new equipment, software, and train- 
ing. Then comes the process of assess- 
ment and evaluation. How do we know 
the technology placed in classrooms 
improves the way teachers teach and 
the way students learn? What evalua- 
tion instruments will we use, and what 
questions will we ask? 

As Supervisor of Instructional Tech- 
nology for Guilford County Schools in 
Greensboro, North Carolina, I faced the 
challenge of assessment and evalua- 
tion in 1998 upon receiving a Technol- 
ogy Literacy Challenge Fund (TLCF) 
grant entitled Project Read/ Write. The 
project’s goal was ‘‘to improve student 
academic achievement in reading and 
writing through the integration of tech- 
nology.” The grant provided ten under- 
achieving third-grade classrooms with 
computers, an inkjet printer, a collec- 
tion of reading/writing software, and 
on-site instructional support. Partici- 
pating teachers were required to attend 
all staff-development sessions and 
allow students to use the technology a 
minimum of 20 minutes, three times 
each week. 

Like most technology leaders, I had no 
expertise in research and evaluation 
even though I had been working in the 
“trenches” of instructional technology 
for many years. ! thought implementa- 
tion and evaluation of Project Read/ 
Write would be quite simple: 1) partici- 
pating teachers would select the soft- 
ware, 2) equipment would be purchased, 
3) teachers would be trained, and 4) stu- 
dent end-of-grade reading scores would 
improve. Experience is a great teacher. 



After four years involved in “action 
research,” I have learned that assess- 
ment and evaluation can be challenging 
and time consuming. Hopefully, you 
can learn from my experiences. 

One of the most valuable resources 
we used to evaluate our project was 
the Evaluation chapter in SEIR^TEC’s 
Planning into Practice (www.seirtec.org/ 
publications). This practical guide assisted 
me in understanding important terms 
and in creating the crosswalk shown 
in the following chart that delineates 
the evaluation questions, methods of 
data collection, and data analysis. Our 
project evaluation focused on answer- 
ing questions related to accountability, 
quality, impact, sustainability, and les- 
sons learned. 

As we implemented Project Read/Write, 
we learned the importance and value 
of determining how well strategies are 
working and making adjustments when 
necessary. Sometimes the adjustments 
were made to project activities and 
sometimes to evaluation strategies. 

Accountability: How do we know the 
project is making a positive impact on 
student achievement? 

Year 1 Question: Did a higher percent- 
age of students receive an “on-grade- 
level” score than in previous years? 
Using North Carolina third-grade end- 
of-grade (EOG) reading scores, a bar 
graph was created charting school EOG 
scores for seven years. Two of the three 
schools achieved their highest scores 
in seven years, and the third school 
achieved its second-highest scores in 
seven years. The data, however, did not 
address other factors that may have 
affected these high scores and were not 
compared to a control group. 



(continued on page 8) 
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Project Goal: To improve student achievement in reading and writing through the integration of technology. 



Question 


Instrument 


Collection 

Period 


Pluses 


Deltas 


Accountability; Is the project making a positive impact on student achievement? 


Did a higher percentage of 
students score Level 111/lV 
than previous years? 


Bar Graph: Percentage 
of students scored 
Levels lll/IV compared 
with previous years 


North Carolina 
third-grade EOG 
reading scores 


Uses validated data 

Identifies trends 

Has potential for 
individual classroom 
and student analysis 


Data do not show 
longitudinal growth for 
individuals 

Graphs show data by 
school — not individual 
or classroom growth 

Does not identify other 
factors impacting test 
scores 


Was student achievement 
higher for the project group 
or the control group? 


Bar Graph: Compare 
scale score growth 
^re-test to End-of- 
Grade) to control group 


Did students in the project 
have higher scale score 
gains and greater movement 
to higher achievement 
levels? 


Table: Compare 
End-of-Grade scores to 
pre-project scores 

Table: Comparison 
of growth within each 
reading level 


Quality: How well are we im| 


Hementing program activities and strategies? 


Is Student use meeting the 
minimal requirements? 


Student logs 


Every two months 


Teacher accountability 
Uses tracking 
Student records 


Reliability of data 
Time intensive 
Personnel demands 


Is student use appropriate 
and accurate? 


On-site visits 
Forms and checklist 


Often as possible 


Data are reliable 
Identifies problems 
Support for teacher 


Time consuming 
Personnel needed 


Are teachers having any 
technical problems? 


Web-based tech help 
Tech support forms 


Collected each 
training session 


Report of technical 
problems 




Has professional 
development been effective? 


Workshop evaluation 
form 


Collected each 
training session 


Immediate feedback 

Identifies areas for 
improvement 


Reliability of 
self-evaluation 

Quality of questions 


Are students effectively 
using the project? 


Formal observation 


Six observations per 
sample participant 


Validates student logs 


Time consuming 
Training observers 
Validation of instrument 


Impact: Is the project makinc 


1 a difference for students? 


Do students think their 
reading and writing skills 
have improved? 


Student survey 


End of the year 


Feedback on student 
attitude and perception 


Time to collect 
Time to interpret 


Do teachers think the 
project has helped improve 
student achievement? 


Teacher survey 


End of the year 


Feedback on teacher 
attitude and perception 


Time to collect 
Time to interpret 


Is there evidence of 
improved writing skills? 

i 


Writing samples 


Fall and spring 


Evidence to validate 
improvement in writing 


Time to develop rubric 

Training scorers 

Time to score and 
analyze 


Sustainability: What needs to be in place for sustaining the projeti's goil? j 


Will hardware and software 
remain adequate? 


Inventory sheets 


Beginning and 
^ ending of year 


Maintains location of 
resources 


Time and accuracy 
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(continued from page 6) 

Year 2 Question: Was student 
achievement higher for the project 
group or the control group? Three 
additional schools participated in Proj- 
ect Read/Write the second year. Fif- 
teen schools were on the waiting list 
to receive funding for the project, and 
they became the control group. During 
the second year, scores from the project 
schools were compared to scores from 
the control group. Project Read /Write 
schools displayed greater gains. 

Year 3 Question: Did students in the 
project have higher-scale score gains 
and greater movement to higher 
achievement levels? In 
the third year, a total 
of 21 schools par- 
ticipated in the 
project. Third- 
grade pretest 
reading scores 
were compared 
to the EOG 
scores, and 
average scale 
score growth 
was charted 
for each school. 

Growth from the 
pre-project year was 
compared to growth from 
the first year of the project. 

Data indicated there was a definite 
trend toward higher achievement levels 
with Project Read /Write schools. 

Quality: How well are the program 
activities and strategies being 
implemented? Is student use meeting 
the minimal requirement? 

Student log sheets were developed to 
assess the quality of implementation. 
During Year 1 , teachers had students 
record their names on a daily log sheet 
when using the computer. However, 
accounting for student software use in 
this fashion proved to be rather prob 
lematic. In Year 2, a yearlong calendar 
was created for each student so that 
he or she could record the title of the 
software used on the appropriate 
calendar day. Teachers were not 
required to submit their calendars 



until the end of school, so teachers not 
using the technology slipped by unno- 
ticed until administrators examined the 
data and discovered there was a prob- 
lem. Finally in Year 3, a valid instru- 
ment for assessing student use was 
developed. A two-month calendar was 
created for each student, and data were 
collected every two months. Data were 
entered into a database, and classroom 
reports were printed and sent to each 
schoofs administration. The new pro- 
cess made teachers accountable and 
provided excellent data for assessing 
the project’s implementation. Some 
students were so dedicated that they 
recorded use on weekends and 
holidays. Conclusion — 
data from student 
log sheets was 
invaluable but 
not always reli- 
able. 

Workshop 
evaluation 
forms are a 
necessity, but 
self-evaluation 
is not always 
reliable. Teach- 
ers indicated they 
were “highly accom- 
plished” in the work- 
ing knowledge of software, 
but informal observations indicated 
otherwise. Teachers reported that they 
had acquired knowledge in the work- 
shop but, upon returning to the class- 
room, forgot a lot of details and could 
not remember how to start. 

Site visits are imperative to ensure 
proper implementation. Site visit 
reports proved to be especially valu- 
able as they provided reliable data 
about technical and/or instructional 
problems within the classrooms. For- 
mal observations validated student 
logs and supplied compelling evidence 
of student use. Trained personnel 
are needed to validate an observation 
instrument and complete the obser- 
vations, but it’s worth the effort to 
validate proper implementation. Once 
a problem is identified, instructional 
support can be readied for the teacher. 
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Impact: Is the project making a 
difference for students? Do students 
think their reading and writing skills 
have improved? 

Answers to these questions were obtained 
by having students complete a survey at 
the beginning and end of the year. Data 
from each survey were reviewed to see if 
student attitudes had improved toward 
reading. Participating teachers from Year 
1 created a student survey that included 
the following statements: 

1. When I have free time, 

I choose to read 

a) never, b) sometimes, c) always 

2. Reading makes me feel 

a) happy, b) no feeling, c) sad 

Expectations were that students would 
change their attitudes toward reading in 
a positive direction, but when surveys 
were collected at the end of the year, 
student feelings had reversed. Student 
interviews revealed that they were excit- 
ed about reading in the fall and spent 
a lot of time reading. However, after the 
winter months, students were ready to 
spend time outdoors, and their interests 
were redirected toward other activi- 
ties. The revised survey has proven to 
be more effective and is completed only 
after end-of-grade tests. It includes the 
following questions: 

1. Are you a better reader now than 
you were at the beginning of the 
school year? (Yes/No) 

2. Do you enjoy reading more now 
than you did at the beginning of 
the school year? (Yes/No) 

Asking the “right” question is critical to 
effective evaluation. 

Sustainability: lA/hat needs to be in 
place for sustaining the project's goal? 
Are all elements in place? 

Sustainability appeared to be a non- 
issue for Project Read/Write. All hard- 
ware with appropriate software was in 
place and working. Project Read/Write 
would help students for many years. All 
teachers had been trained, and student 
use looked great. But had all teachers 
really been trained? 

O 




Seventy-eight classrooms were par- 
ticipating in the project by Year 4, but 
there were 42 new teachers. Of the 
original ten classrooms that began in 
1998, only two teachers remained. How 
could this happen? Teacher turnover 
is a major problem for underachieving 
schools. Turnover makes it difficult to 
bring about change when you consider 
that it takes an average of 4-5 years 
for most teachers to become proficient 
enough with technology to use comput- 
ers fluidly and effectively. To sustain 
Project Read /Write, we must meet the 
chilenge that teacher turnover creates 
every year. 

Looking back, I can safely say that we 
learned a lot of valuable lessons about 
the implementation and evaluation of 
technology projects: 

♦ An evaluation model needs to be 
defined at the beginning of the 
project. 

♦ So many factors impact student 
achievement that change attributed 
to technology use is difficult 

to measure. 

♦ Self-evaluation data are not always 
reliable. 

♦ When possible, use electronic sur- 
veys rather than paper and pencil. 

♦ Although creating quality surveys 
with appropriate questions is a 
challenge, it is crucial to effective 
evaluation. 

♦ Software with built-in management 
systems provides reliable documen- 
tation of student use. 

♦ It takes multiple years for the effec- 
tive implementation of projects to 
impact student achievement. 

♦ Site-visits are a necessity; they pro- 
vide reliable information and sup- 
port for teachers. 

♦ Measuring the quality and impact of 
a technology program takes time and 
may require additional personnel. 

If you’re assessing and evaluating a 
technology program, the SEIR4TEC 
model will provide you valuable infor- 
mation to measure the program’s 
effectiveness. You will learn a lot — 

I guarantee it. ♦ 
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Alabama Indicators for 
Measuring Progress 



by Melinda Maddox, Ed.D., 

Coordinator, Office of Technology 
Initiatives, Alabama Department 
of Education 

Alabama took a bold step when it was 
time to revise our state technology 
plan in 2000-2001. We shifted from an 
emphasis on guidelines and recommen- 
dations for installing hardware and net- 
works to a framework based on a set of 
indicators and benchmarks for measur- 
ing outcomes. The new plan, IMPACT, 
which stands for Indicators for Measur- 
ing Progress in Advancing Classroom 
Technology, establishes essential con- 
ditions — such as funding, support, and 
training — necessary to use technology, 
but its primary focus is using tech- 
nology to improve student learning in 
Alabama’s schools, 

Alabama IMPACT provides a set of 
progress indicators, measures, and a 
target timeline (2002-2005) for inte- 
grating technology across the cur- 
riculum, Examples of sources of 
evidence/data-collection methods are 
provided to help schools and school 
systems assess their progress toward 
meeting the benchmarks established in 
this document. The indicators address 
the six objective areas of learning, tech- 
nology integration, professional devel- 
opment, environment, access, and cost 
of ownership. Local schools and school 
systems are using these indicators and 
benchmarks to design their technol- 
ogy plans for technology integration, to 
make decisions, and to create policies 
to guide the direction of technology. 

Development of IMPACT 

The document was written from the 
ground up with extensive input from 
stakeholders throughout the state. 

This process gained us buy-in from 
the beginning and a gradual growth 
in understanding of the use of indica- 
tors and benchmarks for technology 



planning prior to the rollout of the 
plan. Over the course of one-and-one- 
half years, we convened four different 
task force groups and held several state 
agency staff work sessions. 

♦ Members of the first focus group 
wrote goals and objectives. Their 
task was completed over a two-day 
period. 

♦ The Office of Technology Initiatives’ 
staff further defined the process 
and framework for the plan and 
established the major categories as 
goal, objectives, rationale, indica- 
tors, benchmarks, sources of evi- 
dence, and strategies, 

♦ A second focus group developed 
the document with indicators, 
benchmarks, and sources of evi- 
dence. This group was the main 
writing team and worked about 
six months to complete its tasks. 
The members gathered input from 
district technology coordinators, 
superintendents, and other technol- 
ogy leaders at the annual Alabama 
Educational Technology Association 
(AETA) Fall Symposium. The second 
focus group used this input to final- 
ize the indicators, benchmarks, and 
sources of evidence. 

♦ A third focus group wrote the state 
technology plan requirements for 
district and school technology plans. 

♦ The final focus group wrote state 
strategies. This group represented 
all areas including public, private, 
and business and industry leaders, 
as well as members from ^1 of the 
three previous focus groups. 

IMPACT Example 

The IMPACT document reflects the 
input from all of the focus groups and 
state teams. For each objective, we 
used the same format. The goal — to 
improve learning through the use of 
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technology — is listed first, followed by 
a rationale for the objective, indicators, 
benchmarks, sources of evidence, and 



the data-coUection methods, as shown 
in the following table. 



Learning Objective: Encourage learning that is relevant and authentic through the use of technology. 


Rationale: In classrooms where technology is used effectively as a tool, students are more autonomous, 
collaborative, and reflective than in classrooms where technology is used only for drill and practice. 
Technology engages students in real-life applications of academics and encourages them to be more 
independent and responsible for their own learning. In a knowledge-based society, it is important that 
students have the self-confidence, knowledge base, technology fluency, and cooperative skills that will 
enable them to continue learning throughout their lives. Technology facilitates the study of the academics 
within the context of meaningful and authentic applications. 


Indicators: 


Benchmarks 
(Target year 2005): 


Examples of sources of 
evidence/data-col lection 
methods: 






Surveys 


1a. Learners develop, 
model, and assess age- 
appropriate projects 
that are relevant and 
authentic. 


1.1 All students use technology 
to complete inquiry-based 
learning projects tnat reflect 
personal significance and/or 
societal importance. 

1 .2 All teachers assess student- 
based projects using well- 
designed scoring guides. 

1 .3 All administrators assess 
teachers’ ability to implement 
learner-centered classrooms. 


Student products 

Lesson plans 

Observation 

Video samples 

Standards-based scoring 
guides 

Personnel Evaluation System 
(PEPE) 

Electronic usage data 
Online assessments 


1b. Learners’ work 

incorporates real-world 
applications of technology. 


1.4 All students, teachers, and 
administrators use productivity 
tools such as spreadsheets, 
databases, presentation 
software, and Internet 
resources to solve problems 
and make decisions. 


Surveys 

Student products 
Lesson plans 
Observation 


1c. Learners use technology 
resources to gather, store, 
reshape, analyze, and 
communicate information. 


1 .5 Student products contain 

a data analysis component 
using productivity tools such 
as spreadsheets, graphing 
packages, and/or databases. 

1 .6 All teachers collect and analyze 
data to make adjustments to 
their operational curriculum 
(i.e., classroom). 

1 .7 All administrators collect and 
analyze data to make decisions 
that affect the overall operation 
of the school. 


Surveys 

Student projects 
Lesson plans 
Observation 
Structured interviews 
Online assessments 
Electronic usage data 


Id, Learners use technology 
resources to access 
quality information from 
numerous sources. 


1 .8 All students and teachers 
select appropriate technology- 
based resources such as the 
Internet, real-time probes, 
hand-held devices, and the 
Alabama Virtual Library (avL) 
based on intended purpose. 


Lesson plans 
Student projects 
Observation 

Kersonnei tvaiuaiion Sysiem 
(PEPE) 


1 6. Learners are proficient 
in technology and 
information literacy 
standards. 

> 


1 .9 Aii students and teachers 
use technology during the 
instructional day based on 
the local, state, and national 
standards. 


v3U('vr?y S 

Lesson plans 
Observation 
Student projects 
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Terms 


Definition 


Learners 


Students, teachers, non-certlficated staff, administrators, parents, 
community members, business owners, and citizens 


Goal 


The finai outcome desired 


Rationale 


Reason for the objective 


Objectives 


Broad actions intended to fulflii the goal or outcome 


Indicators 


Attributes or activities that are necessary to fulfili the objective and overall 
goal (These are readily converted to benchmarks.) 


Benchmarks 


Specific, observable, measurable actions or behaviors; used to gauge 
progress overtime 


Sources of Evidence/ 
Data-Collection Methods 


Physical items, such as plans, reports, observations, etc., that enable the 
researcher to document fulfillment of objectives 


Strategies 


Steps or actions that wlii be taken to accompiish the objective 



Reactions from the Field 

By the time we introduced the IMPACT 
document and the concept of using 
technology integration indicators 
and meeting benchmarks to the local 
educators, they were old news. Edu- 
cators had heard so much about the 
new framework that we received very 
positive reactions. Two of our local 
technology educators expressed an 
understanding of the value gained 
from using Indicators to measure 
progress and the acceptance of the 
IMPACT frcimework as follows: 

The Alabama State Department of 
Education's Office of Technology 
Initiatives has provided important 
leadership and guidance to local 



school districts through the IMPACT 
document that was produced to assist 
in the development of district technol- 
ogy plans. IMPACT provided clearly 
defined benchmarks and indicators 
and explained scientificcdly-based 
research as applied to the use of tech- 
nology in the educational process. The 
clearly defined goal and objectives in 
six domains focused limited funding 
toward areas that would have the 
greatest effect on student learning. 
Local district technology coordinators 
have been able to develop technology 
plans that meet the needs of students 
and teachers as a result of IMPACT. 
The use of indicators and bench- 
marks in developing an mdividual 
school and school district technology 
plan are paramount to progress being 






made toward the stated goal School 
leaders and classroom teachers who 
understand the ultimate goal and 
understand the steps that have been 
established to achieve it are more 
likely to enthusiasticcdly embrace the 
process and significantly contribute to 
its achievement. The Alabama Depart- 
ment of Education's Office of Technol- 
ogy Initiatives is to be commended for 
its leadership in providing guidance, 
direction, and support that is on the 
forefront of education reform 

— Steve Sumners, 

District Technology Coordinator, 
Cherokee County School District 

Having state-developed benchmarks 
and indicators for the benchmarks 
helped our system develop its tech- 
nology plan. IMPACT covered all the 
areas that we wanted to address, 
as a system. However, the goals 
and objectives for the state plan 
were general in nature. Working 
with the benchmarks and the indi- 
cators made understanding what 
would be required under these 
broader goals and objectives easy 
to understand. They gave concrete 
examples to follow. That made de- 
veloping our new technology plan 
both easy and productive. 

— David Crouse, Ed.D., 

Technology Coordinator, 

Roanoke City Schools 



Current Status 

Statewide technology assessment 
instruments are being developed to 
measure state progress in achieving 
the benchmarks outlined in IMPACT. 
Currently, local school districts are 
required to align local plans with 
IMPACT and to evaluate and report 
progress toward achieving benchmarks 
on a yearly basis. The local school 
districts are writing their yearly tech- 
nology plans and reporting progress 
toward achieving their benchmarks 
with an online process. At the state 
level, the indicators from IMPACT were 
the basis of our state application for 
the Enhancing Education Through 
Technology application for federal 
funds for educational technology. 

IMPACT gives us a strong focus on 
where we need to go in the next few 
years in educational technology in 
Alabama and will help the state bet- 
ter measure progress in local schools. 

It is a statewide, long-range, strategic 
educational technology plan affect- 
ing every district and every school. By 
having documented outcomes based 
on the state and local indicators and 
benchmarks for educational technol- 
ogy, we already have and will continue 
to receive evidence of the success in 
using technology to impact teaching 
and learning. Taking the bold step to 
not revise but to redesign our state 
technology plan was a risk, but a risk 
well worth taking. ♦ 






State Guidelines for Enhancing 
Education Through Technology 
(EETT) Projects 

Over the past few months, technology leaders in state education agencies (SEAs) 
have been putting together grant application packages for competitive Enhancing 
Education Through Technology grants. Tammy Mainwaring, an Education Asso- 
ciate with the Professional Development and Instructional Technology Office of 
the South Carolina Department of Education, has graciously agreed to share the 
guidelines and sample evaluation matrix that she and her colleagues have devel- 
oped as a resource for educators in their state as they prepare, implement, and 
evaluate their technology projects. The original version has been modified slightly 
to make it generally applicable throughout the region. 

Step 1: Conduct a needs assessment and collect baseline data. The baseline data 
should provide information at the start of a program. The data will be used to set 
goals and benchmarks to determine the amount of change you desire throughout 
the stages of your project. Baseline data are collected before the beginning of the 
project. There are many sources of data that can be collected and utilized effec- 
tively when creating your goals, benchmarks, and expected outcomes. Examples 
of data that can be used include surveys, interviews, school records, standardized 
test scores, observations, technology documents, and portfolios. 

Step 2: Analyze your technology needs through the baseline data and create your 
overall program goals. Limit your program goals to a minimum of three and a max- 
imum of five. Your goals will be the overall statements of expectation arising from 
the purposes of your technology program. Each goal should be accompanied by a 
projected completion date. 



Step 3: Dissect each goal and determine realistic strategies that will lead to the 
achievement of the overall goal. Some goals will require more strategies than others. 
This section outlines your step-by-step process for reaching your end-of-program 
expected outcomes. It also gives you a guide for staying on track with your project. 



Step 4: Develop indicators of achievement. The indicators will be more specific 
than your strategies and will provide a measurement, such as a certain percentage 
of teachers, the number of computers, etc. Setting achievable indicators will be a 
key to the successful completion of your project. 



Step 5: Set benchmarks and target dates that will define the progress the dis- 
trict expects to make at specified points in time with respect to each indicator. 
These benchmarks should show the process for ongoing evaluation of the tech- 
nology project. 




Step 6: List the data sources you will use to continuously measure progress. 

These data will be used in your project reports. 

Step 7 % Describe your expected outcomes of each goal. Student achievement and 
teacher technology proficiency should be integral to your expected outcomes. 

Step Ss Prepare your report of results, findings, and recommendations at the com- 
pletion of your project. 
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Project Goal 

(Should be linked to student 
achievement, teacher proficiency, 
equity of access, and accountability) 


Goal 1 : Teacher Proficiency 

By their next recertification period beginning in 2005, teachers will be deemed 
technologically proficient in accordance with district standards. Teachers must 
renew this proficiency each recertification cycle thereafter. 


Sources of Baseline Data 

(These data will be used to paint a 
current picture of your district prior to 
project implementation.) 


Surveys 

Self-assessments 

Observations 

Portfolios 

District teacher proficiency assurance forms 

(Data for this goal should assist you in determining the percentage of teachers 
who are now considered technology proficient, keep portfolios, and participate in 
professional development opportunities.) 


Strategies for 
Achieving the Goal 

(List relevant strategies to help you 
reach your goal. These must be 
strategies you can measure and prove 
have been implemented.) 


1 . Technology leaders will be assigned to each school to train colleagues and 
guide novices in the use of technology integration. 

2. A needs assessment will be given to teachers to determine the professional 
development that must be offered on different levels of proficiency. Courses 
will be designed and offered to accommodate the faculty as they move from 
novice learners to expert integrators of technology into the curriculum to teach 
the South Carolina state standards. 

3. Teachers will maintain electronic portfolios that will document proficiency using 
a technology skills rubric. 


Indicators 

(These statements must be 
measurable using terms such as a 
percentage of teachers or the number 
of computers, etc.) 


1.1 — By September 2003, one technology leader will be operating in each 
school. 

1 .2 — By September 2003, 30% of teachers will demonstrate use of technology 
integration lessons evidenced through materials in student and teacher 
portfolios. 

(More than one indicator and benchmark can be given for each strategy.) 


Target Benchmarks 

(These define the progress you want 
to make at specified points in time 
with respect to each indicator.) 


1 .1 .1 — The percentage of technology proficient teachers in the district will 
increase from 30% in 2002 to 40 % in 2003. 

1 .1 .2 — The percentage of technology proficient teachers will increase from 40% 
in 2003 to 50% in 2004. 

(You can move through the grant month-by^month, semester-by^semester, 
year by-year, etc.) 


Proposed Process for 
Ongoing Evaluation 

(Each district must have reliable data. 
Districts should be ready to share the 
data with the technical assistance 
teams.) 


Annual submission of teacher technology proficiency assurance forms to the 
State Department of Education 

Random monthly documented classroom walkthroughs and evaluations 

Random monthly examinations for Teacher Technology portfolios to include 
lesson plans, professional activities, student work, etc. 

Record of attendance and completion levels of teacher professional development 
courses 

Teacher self-assessment instruments to be completed biannually 


Data Sources to be Used 
for Ongoing Evaluation and 
End-of-Program Reports 

(Examples include test scores, 
graduation rates, portfolios, 
observations, surveys, and 
interviews.) 


Annual teacher technology proficiency assurance forms 

Classroom observation walkthrough documentation 

Notes transcribed regarding the quality and content of teacher technology 
portfolios 

Biannual teacher self-assessments 
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Desired Outcomes 

1 (Should be linked to student 
achievement, teacher proficiency, 
equity of access, and accountability.) 


By the year 2009, all teachers will be technologically proficient in integrating 
tec^^ology as a tool to i^ci'oase student to teaci^ ^i^e smjth 

Carolina slaTe standards. 






TA6LIT: A Tool for Measuring a 
Project's Results 



by Katherine Tankson, Director of the 
Mississippi TASL Grant, and Betty 
Lou Pigg, Information Technology 
Planner with the Mississippi 
Department of Education 

Note: The Taking a Good Look at Instruction- 
al Technology (TAGLIT) assessment tool is 
an element of each staters Bill and Melinda 
Gates Technology Leadership grant For fur- 
ther irformation on the use of TAGUT, con- 
tact the administrator for your state’s Gates 
Technology Leadership grant 

How can educators make informed 
decisions that result in successful uses 
of technology for teaching and learn- 
ing? How can they know if their deci- 
sions are having an impact? To many 
administrators and school technology 
leaders, these questions present major 
challenges. However, a growing number 
of educators have discovered a solution. 
They are using TAGLIT (Taking a Good 
Look at Instructional Technology) to 
determine the perception of technology 
use and impact at their schools and to 
measure changes resulting from tech- 
nology projects and initiatives. Missis- 
sippi administrators are among those 
using TAGLIT to evaluate technology 
initiatives. 

TAGLIT is an online suite of self- 
assessment tools for school leaders, 
teachers, and students that provides 
measurements of progress over time 
(www.taglit.org). Dr. Sheila Coiy and Jen- 
nifer Peterson developed the tools for 
participants in the Principals as Tech- 
nology Leaders Program offered by the 
North Carolina Principals Executive 
Program. The Web version was initially 
supported by the BellSouth Foundation 
and is currently Web-enabled by SAS 
with support from the Bill and Melinda 
Gates Foundation. As a result of this 
support, many educators are aware of 
and have used the TAGLIT tools. Why? 
Every state has a Gates Foundation 
state challenge grant for technology 
leaders, and a requirement of the grant 



is that all participants — mostly princi- 
pals — in the grant must complete the 
TAGLIT assessment for school leaders. 
In turn, the school leaders are to have 
their teachers complete the teacher tool, 
and they have the option to have their 
students complete the student tool. 

The Mississippi Department of Education 
was one of the earliest users of TAGLIT 
as a component of the Gates Foundation 
challenge grant. The grant established 
the Technology Academy for School 
Leaders (TASL). Participants in the week- 
long academy and follow-up sessions 
have discovered that TAGLIT data help 
them accomplish the TASL goals: 

♦ To facilitate the integration of tech- 
nology in the total district/school 
environment. 

♦ To enhance the principals’ and 
superintendents’ technology leader- 
ship skills in support of teaching, 
learning, and data-driven decision 
making. 

♦ To facilitate the creation of learning 
environments that empower staff to 
infuse technology into teaching and 
learning. 

♦ To assist school leaders in the defi- 
nition of local issues and the devel- 
opment of solutions and strategies 
to address them. 

In the Mississippi TASL project, the 
suite of assessments is explained to 
participants during the academy and 
during the Day 1 Follow-up Activ- 
ity conducted three months after the 
academy. Participants are trained to 
interpret the Data Summary report and 
generate their Final Report. Each par- 
ticipating principal in TASL is respon- 
sible for monitoring the administration 
of TAGLIT to 100% of the instructional 
staff and 50% or higher of the student 
population in grades 3-12 and for com- 
pleting the leader’s assessment for his/ 
her assigned school. 
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TAGLIT generates valuable data for 
administrators about ways technology 
is being used in their schools. Adminis-* 
trators did not previously have a means 
to collect and analyze this type of data, 
especially in the quantity that TAGLIT 
provides. School leaders answer 69 
questions on technology planning, 
hardware, software, instructional and 
technical support, budgets, policies, 
and community involvement. Teachers 
answer questions (6 1 for elementary 
teachers and 7 1 for middle and high 
school teachers) on skills, frequency of 
use, how technology affects classroom 
activities, technology planning, hard- 
ware, software, and instructional and 
technical support. Students complete 
questions on skills, frequency of use, 
and how technology affects classroom 
activities — 15 questions for elemen- 
tary school students and 53 for middle 
and high school students. With this 
quantity and range of data, school 
administrators who administer the 
assessments periodically have a means 
of measuring progress of technology 
use and impact at their schools. 

For our administrators, TAGLIT has 
played an integral part in helping them 
better understand the following: 

♦ The role of technology in enhancing 
teaching and learning. 

♦ The present status of teachers’ and 
students’ technology skills and use. 

♦ School technology planning, bud- 
geting, and professional develop- 
ment needs. 

♦ The availability of emerging tech- 
nologies in the schools. 

The results of the TAGLIT assessments 
have been an eye opener for many of 
the TASL participants. One of the state- 
ments on the Day 2 Follow-up Activ- 
ity (conducted nine months after an 
academy) was “The TAGLIT information 
provided my district/schools was valu- 
able information that has impacted our 
professional development program and 
technology integration.” On a scale of 
1 to 5, with 5 — Strongly Agree, 4 — Agree, 
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and 1 — Strongly Disagree, 78% of the 
participants rated this question a 5 and 
22% a 4. Comments made by some of 
the participants included: 

♦ “The TAGLIT results identified tech- 
nology training as our number one 
professional development need.” 

♦ “Significant training is needed in 
getting our teachers ready to effec- 
tively integrate technology into 
classroom instruction.” 

♦ “More time must be spent in train- 
ing our teachers so that they can 
be successful in preparing our stu- 
dents for this technological age.” 

Many of the participating principals 
have used the TAGLIT assessment 
results to document the considerable 
need for training in the area of technol- 
ogy use and integration. As a result of 
their analysis of the data, they have 
scheduled the Phase Technology Train- 
ings offered through the Mississippi 
Office of Educational Technology and 
the MarcoPolo Training (online class- 
room technology integration). Addi- 
tionally, principals are also sending 
teachers to technology training ses- 
sions to become school-site technology 
trainers and placing more emphasis on 
technology-based professional develop- 
ment. Many are encouraging teachers 
to either take courses online or par- 
ticipate in interactive video (distance 
learning) course offerings to receive 
advanced degrees, licensure renewal, 
and/or technology professional growth. 

Increased emphasis on technology pro- 
fessional development is not the only 
result of having the TAGLIT data avail- 
able. At the state level, we have used it 
as part of our project evaluation and to 
help improve the activities of the TASL 
project. Certainly the data will be useful 
for future grant proposal writing and for 
state program policy development. 

Whetiier' at the school level or witii 
the state project, TAGLIT, as a tool 
for measuring a project’s results, is 
making a difference in the Mississippi 
school districts. ♦ 
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Steps in Evaluating a School or 
District Technology Program 



by Jeff Sun, Sun Associates 

Sun Associates — an educational con- 
sulting firm and frequent SEIR^TEC 
collaborator — has worked with a num- 
ber of school districts to develop and 
facilitate formative evaluations of 
technology’s impact on teaching and 
learning. Over the past several years, 
we have worked with districts in Ken- 
tucky, New York, Massachusetts, and 
Michigan to create research-based 
formative evaluations that are used to 
measure a district’s progress toward 
meeting its own strategic goals for tech- 
nology implementation and integration. 
In most cases, our client districts have 
taken the developed evaluation proce- 
dures and have applied them annually 
to support a formative approach to 
assessing their technology efforts. 

The process most often employed with 
districts consists of three interrelated 
stages: evaluation framing, data collec- 
tion, and reporting. 

Stage 1 — Evaluation framing, 
committee orientation, and rubric 
development 

Just as with technology planning, tech- 
nology evaluation is a committee-driven 
process. Therefore, the first step in this 
process is for the district to appoint 
an evaluation committee composed of 
district stakeholders such as teachers, 
administrators, parents, board mem- 
bers, and students. The exact composi- 
tion varies and reflects the values and 
priorities of the district that is conduct- 
ing the evaluation. Once the committee 
is selected, we facilitate a full day of 
training for the committee. During this 
training, the entire evaluation process 
is overviewed, milestones are set, and 
initial responsibilities are assigned. 

After its initial day of training, the com- 
mittee meets for another two days to 



develop the district’s key evaluation 
questions and to create indicators for 
those questions. WTiile the developed 
indicators are always tied directly to the 
district’s own strategic vision and goals 
for technology, we also key the indica- 
tors to standards and frameworks such 
as the National Educational Technol- 
ogy Standards (NETS) for students and 
Milken’s Seven Dimensions, as well as 
local and state curriculum frameworks. 

In most cases, the evaluation commit- 
tee breaks into subcommittees to devel- 
op indicators for individual questions. 
Once these indicators have been devel- 
oped and approved by the district com- 
mittee, we organize all of this work into 
a set of indicator rubrics. These rubrics 
(see www.$un-d$$ociates.com/eval/$ampl6.html 
for examples) form the basis for the 
district’s evaluation work. 

Stage 2 — Data collection and analysis 

Data collection is designed in response 
to the district’s evaluation rubrics. Data 
are gathered that will enable the district 
to answer the evaluation questions and 
score its performance on its evalua- 
tion rubrics. Typically, a data- collection 
effort will include: 

♦ Surveys of teachers, administrators, 
students, and/or community mem- 
bers. Unique surveys are created 
for each target population and are 
based on the data- collection needs 
described in the district’s rubrics. 

♦ Focus group interviews of teachers, 
administrators, students, technol- 
ogy staff, and other groups of key 
participants in the district’s educa- 
tional and technology efforts. 

♦ Classroom observations. External 
evaluators will typically spend time 
in schools aind classrooms through- 
out the district. The evaluators not 

(continued on page 20) 
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(continued from ^990 18 ] 

only observe teachers and students 
using technology but also find that 
we can learn much about how tech- 
nology is being used to impact teach- 
ing and learning just by observing 
classroom setups, teaching styles, 
and student behaviors. 

It is important that the data-collection 
effort not rely on a single data source 
(e.g., surveys). The district needs to 
design a data-collection strategy that 
has the optimum chance of capturing 
the big picture of the use and impact of 
technology within the district. This will 
require the simultaneous use of mul- 
tiple data-collection strategies. 

Stage 3 — Findings, recommendations, 
and reporting 

Reporting is important to a formative 
ev^uation in that it establishes a com- 
mon base for reflection. An evaluation 
that is not shared with the community 
it evaluates never results in reflection. 
Reflection is necessary for positive 
and informed change. The first step in 
reporting is to take the data gathered in 
the previous stage to score the district’s 
performance against its own rubrics. 



These scores — along with a detailed 
explanation of how scores were given — 
form the basis of the report. In addi- 
tion, reports typically contain detailed 
findings and recommendations. The 
recommendations relate to how the 
district can adapt or change current 
practices to achieve higher levels of 
performance in succeeding years. The 
recommendations are always based on 
a research- in tensive knowledge of best 
practices as related to teaching, learn- 
ing, and technology. Recommendations 
are relative to findings. In other words, 
recommendations are in sync with a 
district’s desired outcomes as docu- 
mented in its indicator rubrics. 

In most cases, evaluation projects end 
with a formal presentation to the dis- 
trict committee and other audiences 
as identified by the overseeing admin- 
istrator. The districts then distribute 
the document and begin implementa- 
tion. This is the point at which the next 
review cycle begins. 

These steps for evaluating a technology 
plan are appropriate for most schools and 
districts. As the chart indicates, this is 
a cyclic process for continuous improve- 
ment and for greater impact on students 
and the educational program. ♦ 
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Thinking Beyond Surveys 

by Anna Li, Ph.D., SEIR^TEC Evaluator 

For several reasons, surveys are t±ie most commonly used tool for evaluating tech- 
nology programs. First, they can measure a variety of elements of the program and 
participant characteristics, such as the number of computers in a school, teach- 
ers’ and students’ attitudes, opinions, behaviors, and other descriptive informa- 
tion. Another positive feature of surveys is that, compared with other evaluation 
methods, they are relatively inexpensive and can be quickly administered to a large 
number of people. A third aspect is that survey findings usually lend themselves to 
quantitative analyses, and the results can be expressed in easily understood 



percentages 
and means, 
which in 
turn can be 
presented in 
easily under- 
stood charts 
or graphs. 

However, since 
the primary 
way to collect 
information 
through sur- 
veys is to ask 
people written 
questions, the 
evaluator has 
no control over 
misunderstand- 
ing and misin- 
terpretation of 
the questions, 
missing data, 
or inaccurate 
responses. If 
the entire tech- 
nology-program 
evcduation 
design depends 
on surveys or 
self-reporting 
data, the find- 
ings could be 
biased or not 
reflect a com- 
plete picture of 
a technology 
program s 
quality and 
effectiveness. 
Therefore, it is 
important to 
think beyond 
surveys and to 
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TABLE I: DATA-COLLECTIOtl METHODS 




Data-collection 

methods 


Advantages 


Disadvantages 


Questionnaires 
(self-administered) ^ 

1 . 


Good for finding answers 
' to short, simple questions; i 

1 relatively inexpensive; can 
reach a large population in a 1 

short time. ' 

^ i 


1 Low response rate; no control 
! over misunderstanding or 
1 misinterpretation of the questions, 

1 missing data, or inaccurate 
■ responses; not suited for people 
1 who have difficulty reading and 
i writing; not appropriate for complex 
1 or exploratory issues. 


Interviews 


Yield rich data, details, and 
new insights; interviewers 
can explain questions that 
the interviewee does not 
understand; interviewers can 
probe for explanations and 
details. 


Can be expensive and time 
consuming; limited sample size; 
may present logistics problems 
(time, location, privacy, access, 
safety); need well-trained 
interviewer; can be difficult or time 
consuming to analyze qualitative 
data. 


Focus groups 

! 


: Useful for gathering ideas, 
different viewpoints, new 
1 insights from a group of people 
at the same time; facilitator can 
probe for more explanations 
or details; responses from one 
person provide stimulus for i 

other people. | 


1 Some individuals may dominate the 
discussions while others may not 
like to speak in a group setting; hard 
to coordinate multiple schedules; 
takes longer to have questions 
answerea, 

I 


Tests 


Provide “hard data” that are 
easily accepted; relatively easy 
to administer. 


Difficult to find appropriate 
instruments for treatment 
population; developing and 
validating new tests may be 
expensive and time consuming; 
tests can be biased and unfair. 


Observations < 

1 

i 


. Best for obtaining data about [ 

behaviors of individuals or | 

1 groups; low burden for people 

' providing data. 1 

1 . 


j Time consuming; some items are 
1 not observable; participant behavior 
I may be affected by presence 
of observer; needs well-trained 
observer. 

j 


Archival documents 

(student records, school plans, 

past program evaluations, etc.) 


Low burden for people 
providing information; relatively 
inexpensive. 


May be incomplete or require 
additional information; may need 
special permission lo use. 


Artifacts or products 


Good evidence of impact; low 
burden for people providing 
data; relatively inexpensive. 


i May be Incomplete or require 
additional interpretation. 
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look at other evaluation designs and data-collection techniques. There are seven 
commonly used data-collection methods in educational technology program evalu- 
ation. Table 1 (previous page) summarizes the methods and describes their advan- 
tages and disadvantages. 

Depending on the needs of the programs, a sound evaluation design incorpo- 
rates three or more of the above methods. Which methods to use should be deter- 
mined by the evaluation questions, and complex questions often call for multiple 
sub -questions, each of which would have an appropriate data-collection method. 
For example, a frequently asked question of technology programs is: “How are 
teachers and students actually using technology?” This is a complex question 
that might be divided into several sub-questions about the extent, nature, and 
frequency of teacher and student technology use. Table 2 below, which is drawn 
from the National Science Foundation’s User Friendly Handbookfor Project Evalua- 
tion (www.ehr.nsf.gov/RED/EVAL/handbook.httn), shows a simplified version of an evaluation 
design matrix. 



TABLE 2: DESIGN MATRIX 



Sub-question 


Data-collection approach 


Respondents 


Schedule 


1a. Did teachers use 
technology in 
their teaching? 


^ Questionnaires 
Observations 


i Teachers 
Supervisors 
: N/A 


1 Pre/post project 
Twice per semester i 


1b. Did students use 
technology to 
learn science, 
math, or other 
subject areas? 


Questionnaires 

Interviews 

Observations 


Students 

Teachers 


Pre/post project 
Twice per semester 


1c. How often did 
teachers use 
technology? 


s Questionnaires i 


Teachers 

Students 

Supervisors 


j Pre/post project j 



The National Science Foundation handbook (p.l9) suggests you 
pose the following questions when you want to determine the 
most appropriate approaches to data collection: 



1 . Do you want to explore the experiences of a small number of 
participants in-depth (case studies) or get general experience 
for a larger population (survey)? 

2. If you select a survey approach, do you want to survey all the 
participants, or can you select a sample? 

3. Do you want to evaluate what happens to project participants 
or to compare the experiences of participants with those of the 
non-participants (quasi-experimental design)? 

How these questions are answered will affect the design of the 

evaluation as well as the conclusions that can be drawn. ♦ 
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Resources for Evaluation: 

An Annotated Bibliography 

by Dan Shoemaker, Senior Educational Technology Specialist, SEIR^TEC, 
and Jennifer Burke, Media Specialist, Centennial Place Elementary 
School, Atlanta 

As educators seek research to guide the development of their evaluation plans 
or tools to use in evaluating their technology initiatives, they often turn to the 
Internet. Conducting an Internet search can result in an overwhelming list of 
possible sources of information. Weeding out the useful from the barely appli- 
cable is a true headache-producing task. 

SEIR4TEC staff have tackled the task for you. In the charts below, you will 
find an annotated bibliography of research studies and reports focused on 
the evaluation of technology programs. Among the items listed, you should 
find several that will be just what you are looking for to use in your technol- 
ogy initiative evaluation plan. 

Books 

1. Aspen Education Development Group. (2001). Administrator's guide 
to technology: Planning, Jiinding & implementation. Frederick, MD: 

Aspen Publishers. 

This document provides guidelines related to instructional technology and 
planning for administrators. Topics covered include developing a technol- 
ogy plan, facility assessment, e-rate planning, formation of a technology 
committee, budget planning, and hardware/software replacement plan 
and costs. Chapter 7 covers assessment and accountability, including 
evaluating a technology program, technology assessment surveys, and 
technology standards for continuous student assessment. Appendices 
include a glossary and a list of resources for acceptable-use policies, as- 
sessment and accountability, assistive technology, website accessibility, 
curriculum integration, distance education, funding, hardware suppliers, 
international collaboration on the Web, legal issues, professional develop- 
ment, school website design, technology planning and implementation, 
telementoring, virtual schools, and Web safety. 

2. Fink, A., & Kosecoff, J. (1998). How to conduct surveys [2^ ed.). Thousand 
Oaks, CA: Sage Publications. 

Popular for helping readers organize a rigorous survey and evaluate the 
credibility of other surveys by giving them practical, step-by-step advice, 
the second edition also covers computer-assisted and interactive surveys 
and how they contrast with telephone and face-to-face surveys. 

3. Hedrick, T. E., Bickman, L. R, & Rog, D. J. (1993). Applied research 
design: A practical guide. Thousand Oaks, CA: Sage Publications. 

Ajmed at helping researchers and students make the transition trom the 
classroom and the laboratory to the **real” world, the authors reveal pit- 
falls to avoid and strategies to undertake in order to overcome obstacles 
in the design and planning of applied research. The book focuses on re- 
fining research questions when actual events force deviations from the 
original analysis. 
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4. Maruyama, G., & Deno, S. (1992). Research in educaUoncd settings. 
Thousand Oaks, CA: Sage Ekiblications. 

This book focuses on the following issues: access and credibility in the 
school: traditional issues in designing research: questions that emerge as 
the design is imposed on the school culture and setting, particularly in 
regard to school staff and student assessment: the length of interventions 
and whether or not to schedule follow-up studies: and how to interpret and 
communicate findings to schools and poliC3Tnakers. 

5. Quinones. S.. & Klrshstein, R. (1998). An educator’s guide to evaluating the 
use of technology in schools and classrooms. Washington, DC: United States 
Department of Education. www.ed.gov/pubs/EdTechGuide. 

This guide was developed for the U.S. Department of Education by the 
American Institutes for Research in conjunction with its formative evalu- 
ation of the Technology Literacy Challenge Fund. The guide represents a 
joint effort among the Office of Educational Research and Improvement, the 
Office of Educational Technology, and the Office of Elementary and Second- 
ary Education. The guide should be viewed as a tool for individuals who 
have little or no formal training in research or evaluation. This publication 
is available online in PDF format. 

6. Stevens, F., Lawrenz, F., & Sharp, L. User friendly handbook for project 
evaluation: Science, mathematics, engineering and technology education. 
Retrieved August 15, 2002, fromWWW.ehr.nsf.gov/RED/EVAL/handbookAandbook.htm. 

This handbook was developed to provide Principal Investigators and Project 
Evaluators working with the National Science Foundation’s Directorate for 
Education and Human Resource Development with a basic understand- 
ing of selected approaches to evaluation. It is aimed at people who need to 
learn more about what evaluation can do and how to do an evaluation rath- 
er than those who already have a solid base of experience in the field. This 
publication is available online in PDF format. 

Journal articles 



1. Moreland, J., & Jones, A. (2000). Emerging assessment practices in an 
emergent curriculum: Implications for technology. InternationalJournal 
of Technology and Design Education, 10(3), 283-305. www.techednz.org.nz/ 
n researeh.shtml. 



Reports on detailed case studies into emerging assessment practices in 
technology in two New Zealand primary schools. Topics include classroom 
assessment, formative and summative assessment, teacher knowledge, 
subculture influences when implementing technological activities, knowl- 
edge about technology, knowledge in technology, student self-assessment, 
and expectations of transfer. 



2. Sanders, M. (2000). Web-based portfolios for technology education: 

A personal case study. Journal of Technology Studies, 26(1), 1 1-18. 
http://scholar.lib.vt.edu/ejournals/JTS/lVinter-Spring-2000/pdf/sanders.pdf. 

Students can use Web-based portfolios m technology classes to display class 
and project work. Developing effective websites gives them an understand- 
ing of a range of information-age tools, motivates them to do high-quality 
work, requires self assessment and reflection, and teaches design. ski.lls 



Wenglinsky, H. (1998). Does it compute? The relationship between education- 
al technology and student act 

www.icoe.k12.ca.us/pdf/technoiog.pdf. 



ai technology and student achievement in rriatiierrtuiies. Fiiiiceion, NJ. ET3 
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This report presents findings from a national study of the relationship be- 
tween different uses of educational technology and various educational 
outcomes. It uses the 1996 National Assessment of Educational Progress 
(NAEP) in mathematics. 

4. Woodrow, J. E., Mayer-Smith, J., Jolie, A., & Pedretti, E. G. (2000). Assess- 
ing technology-enhanced instruction: A case study in secondary science. 
Journal of Educational Computing Research, 23(1), 15-39. 

Describes an evaluation program designed to assess the effectiveness of 
technology-enhanced instruction within the context of the Technology 
Enhanced Secondary Science Instruction (TESSI) project, a field-based 
research program of technology integration into secondary science. It in- 
cludes analyses of student enrollment and achievement, ethnographic as- 
sessment, scalability, and interviews with graduates. 

Papers presented at conferences and meetings 

1 . 2000 Conference on Educational Technology, Measuring the Impacts and 
Shaping the Future. 

The conference focused on the effective use of technology in schools. The 
site (www.ed.gov/Technology/evaluation.html) includes papers and presentations from 
the Education Secretary’s Conference on Educational Technology as well as 
evaluation tools. Site is updated to 2002. 

2. Heinecke, Blasi, Milman, & Washington. (1999). New directions in the 
evaluation of the effectiveness of educational technology. Paper presented 
at the 1999 Education Secretary’s Conference on Educational Technology. 
www.ed.gov/Technology/TechConf/1999/whitepapers/paper8.html. 

The paper addresses the importance of looking at new ways to evaluate the 
effectiveness of educational technology that incorporate a variety of ways to 
assess programs. 

3. Mize, C. D., & Gibbons, A. (2000). More than inventory: Effective inte- 
gration of instructional technology to support student learning in K-12 
schools. Society for Information Technology & Teacher Education Internation- 
al Conference: Proceedings of SITE 2000, San Diego, California, February 
8 - 12 , 2000 . 

This paper is a report of three case studies considering the instructional 
uses of technology in public school classrooms. A level of technological pro- 
ficiency was determined for each school that participated in the research 
through the use of a series of surveys, teacher interviews, and observations. 

4. Peterson, L. (1999, April). Traiisforming the daily life of the classroom: The 
District Six Laptop Project Paper presented at the Annual Meeting of the 
American Education^ Research Association, Montreal, Quebec, Canada. 

The paper discusses The Community School District Six Laptop Project 
(New York, NY) that was created in order to increase access to technology 
for families in a low- income area with a large immigrant population. Find- 
ings from both groups are discussed in terms of collaboration, the writing 
process, research sWlls and critical evaluation of information, and pre- 

c<antotinT>c P#a>cn1tc nf tVipf IpntnnQ in 

^ ^ ^ 

management of tiie classroom and in tiie design of instr uctional activities 
and assignments. http://metisassoe.eom/Publications/aera.htm. ♦ 
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Tools for Evaluating 
Technology Projects and Programs 

by Dan Shoemaker^ Senior Educational Technology Specialist, SEIR^TEC, and 
Jennifer Burke, Media Specialist, Centennial Place Elementary School, Atlanta 

Finding an evaluation tool that has been tried and tested puts you one step ahead. 
The resources listed below have been used or developed by SEIR^TEC or other 
RTECs and are worth considering when you are searching for a tool to use to eval- 
uate your technology initiative. 



1* CEO Forum STaR Chart 

(www.e6oforum.org/stdrehart.cfm) 

Developed by the CEO Forum on 
Education & Technology, the STaR 
Chart identifies and defines four 
school profiles ranging from the 
“Early Tech’* school with little or 
no technology to the ‘Target Tech” 
school that provides a model for 
the integration and innovative use 
of education technology. The STaR 
Chart is not intended to be a mea- 
sure of any particular school’s tech- 
nology and readiness, but rather to 
serve as a benchmark against which 
every school can assess and track 
its own progress. 

2. enGauge (www.nerel.org/engauge) 

Developed by NCREL with the Metiri 
Group. enGauge provides a com- 
prehensive view of critical factors in 
an educational system that strongly 
influence the effectiveness of educa- 
tional technology. It is a Web-based 
framework and tool set designed 



to help districts use technology ef- 
fectively for learning, teaching, and 
managing. The enGauge framework 
identifies Six Essential Conditions, 
which are system-wide factors criti- 
cal to effective uses of technology 
for student learning. 

3. INSIGHT, South Central 
RTEC Instrument Library 
and Data Recovery 
(http://insighf.southeentrdlrt6e.org/welcome.hfml) 

INSIGHT, the South Central RTEC 
Instrument Library and Data Repos- 
itory. is an evaluation resource that 
serves a broad range of educational 
constituents. It consists of two dis- 
tinct but interrelated components: 

♦ The INSIGHT Instrument 
Library provides a centralized 
library of Web-enabled educa- 
tional evaluation surveys and 
instruments and is available for 
program and project evaluators 
in K-16 education. 

♦ The INSIGHT Data Repository is 
a research tool containing the 
accumulated historical record 
of administrations of evaluation 
instruments housed in the In- 
strument Library. 

Learning from Logic Models: An 
Example of a Family/School Part- 
nership Program (www.gse.harvard.edu/ 
'^hfrp/pubs/onlinepubs/logic.pdf) 

This brief offers a step -by- step 
approach for developing and 
using a logic model as 
a iramework for 
a program’s 
or organi- 
zation’s 
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evaluation. Its purpose is to provide a tool to 
guide evaluation processes and to facilitate 
practitioner and evaluator partnerships. 

5. North Central Regional Technology in 
Education Consortium (NCRTEC) 

(www.ncrtec.org/capacity/profile/profwww.htm) 

Developed by the NCRTEC, the Learning with 
Technology Profile Tool will allow comparison 
of current instructional practices with a set 
of indicators for engaged learning and high- 
performance technology. For each category, 
there is a description of the indicators and ex- 
amples that fall along a continuum. 

6. Planning into Practice 

{www.ceirtec.org/plan/Ch%207.pdf) 

As a result of SEIR4TEC’s work in various 
schools, several valuable tools have been 
identified that are particularly useful in help- 
ing districts and schools create strategic edu- 
cational technology plans. Chapter 7 of this 
publication addresses evaluation and pro- 
vides several tools that may be useful for pro- 
gram evaluation. This publication is available 
online in PDF format. 

7. Profiler (http://profiler.hprtec.org) 

Developed by the High Plains Regional Tech- 
nology in Education Consortium (HPR^EC), 
the Profiler tool and ready-to-use surveys of- 
fer a means to improve people’s skills around 
a general topic, strengthen their understand- 
ing of a topic, or increase their ability to 
share expertise. Surveys can be customized 
for a group and stored on and accessed from 
the HPR^EC server. 

8. SE1R4TEC Progress Gauge 

{www.seirtec.org/evdi/gduge.doc) 

Developed by SEIR4TEC, the Progress Gauge 
is used to help school leaders reflect on activi- 
ties to date in technology integration, think 
about what needs to be done in order to im- 
pact teaching and learning through the use 
of technology resources, and consider strate- 
gies for maximizing the impact of technology. 
The SEIR4TEC Progress Gauge is also avail- 
able in an online format in conjunction with 
HPR^TEC using the Profiler tool. 

9* TAGLIT (www.taglit.org/tdglit/login.acp) 

Taking A Good Look at Instructional Technol- 
ogy (TAGLIT) is a suite of assessment tools 
designed to help principals and other school 
leaders gather, analyze, and report informa- 
tion about how technology is used for teach- 
ing and learning in their schools. ♦ 
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SEIR4TEC W/elcomes Kevin Oliver 

Kevin Oliver is the new Project Director for SEIR^TEC as 
of October 1®‘. He comes to Durham from Virginia Tech 
where he worked as an Instructional Design and Evalu- 
ation Specialist since 1999. Kevin also formerly worked 
as an Instructor for the Department of Curriculum and 
Instruction at Southern Illinois University, teaching grad- 
uate-level instructional technology courses to pre- service 
and in- sendee teachers, and as an Educational Media Specialist for the 
UNC-Chapel Hill School of Nursing. 

Kevin received his Ph.D. in Instructional Technology from the University 
of Georgia where he participated in teacher training and the integration 
of science Web tools in a rural school system. He also holds a M.Ed. 
in Educational Media and Instructional Design from UNC-Chapel Hill 
and a B.S. in Communications from the University of Tennessee. Kevin 
has consulted with computer software companies in North Carolina 
and Georgia, and he interned with educational media agencies at the 
U.S. Air Force Academy and Xerox. Since 1992, he has given more than 
30 presentations at regional, national, and international conferences; 
authored or co-authored 13 technology- related publications in journals; 
and authored or co-authored funded educational technology grants from 
the Mellon Foundation, Apple Computer, the U.S. Department of Educa- 
tion (Challenge Funds), FIPSE, and the National Science Foundation. 
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